Nov 13 17:15:11 user nova-compute[75100]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75100) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75100) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75100) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 17:15:11 user nova-compute[75100]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:15:11 user nova-compute[75100]: INFO nova.virt.driver [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 13 17:15:11 user nova-compute[75100]: INFO nova.compute.provider_config [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] Acquiring lock "singleton_lock" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] Acquired lock "singleton_lock" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] Releasing lock "singleton_lock" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] Full set of CONF: {{(pid=75100) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ******************************************************************************** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] Configuration options gathered from: {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ================================================================================ {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] allow_resize_to_same_host      = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] arq_binding_timeout            = 300 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] backdoor_port                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] backdoor_socket                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] block_device_allocate_retries  = 300 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] block_device_allocate_retries_interval = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cert                           = self.pem {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute_monitors               = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] config_dir                     = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] config_drive_format            = iso9660 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] config_source                  = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] console_host                   = user {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] control_exchange               = nova {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cpu_allocation_ratio           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] daemon                         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] debug                          = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] default_access_ip_network_name = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] default_availability_zone      = nova {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] default_ephemeral_format       = ext4 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] default_green_pool_size        = 1000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] default_schedule_zone          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] disk_allocation_ratio          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] enable_new_services            = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] enabled_ssl_apis               = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] flat_injected                  = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] force_config_drive             = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] force_raw_images               = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] graceful_shutdown_timeout      = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] heal_instance_info_cache_interval = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] host                           = user {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] instance_build_timeout         = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] instance_delete_interval       = 300 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] instance_name_template         = instance-%08x {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] instance_usage_audit           = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] instance_usage_audit_period    = month {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] internal_service_availability_zone = internal {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] key                            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] live_migration_retry_count     = 30 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] log_config_append              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] log_dir                        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] log_file                       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] log_options                    = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] log_rotate_interval            = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] log_rotate_interval_type       = days {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] log_rotation_type              = none {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] long_rpc_timeout               = 1800 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] max_concurrent_builds          = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] max_concurrent_live_migrations = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] max_concurrent_snapshots       = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] max_local_block_devices        = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] max_logfile_count              = 30 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] max_logfile_size_mb            = 200 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] maximum_instance_delete_attempts = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] metadata_listen                = 0.0.0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] metadata_listen_port           = 8775 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] metadata_workers               = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] migrate_max_retries            = -1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] mkisofs_cmd                    = genisoimage {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] my_ip                          = 10.0.0.210 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] network_allocate_retries       = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] osapi_compute_listen_port      = 8774 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] osapi_compute_unique_server_name_scope =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] osapi_compute_workers          = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] password_length                = 12 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] periodic_enable                = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] periodic_fuzzy_delay           = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] pointer_model                  = ps2mouse {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] preallocate_images             = none {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] publish_errors                 = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] pybasedir                      = /opt/stack/nova {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ram_allocation_ratio           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] rate_limit_burst               = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] rate_limit_except_level        = CRITICAL {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] rate_limit_interval            = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] reboot_timeout                 = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] reclaim_instance_interval      = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] record                         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] reimage_timeout_per_gb         = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] report_interval                = 120 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] rescue_timeout                 = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] reserved_host_cpus             = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] reserved_host_disk_mb          = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] reserved_host_memory_mb        = 512 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] reserved_huge_pages            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] resize_confirm_window          = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] resize_fs_using_block_device   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] resume_guests_state_on_host_boot = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] rpc_response_timeout           = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] run_external_periodic_tasks    = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] running_deleted_instance_action = reap {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] running_deleted_instance_timeout = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] scheduler_instance_sync_interval = 120 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] service_down_time              = 720 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] servicegroup_driver            = db {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] shelved_offload_time           = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] shelved_poll_interval          = 3600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] shutdown_timeout               = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] source_is_ipv6                 = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ssl_only                       = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] state_path                     = /opt/stack/data/nova {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] sync_power_state_interval      = 600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] sync_power_state_pool_size     = 1000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] syslog_log_facility            = LOG_USER {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] tempdir                        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] timeout_nbd                    = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] transport_url                  = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] update_resources_interval      = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] use_cow_images                 = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] use_eventlog                   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] use_journal                    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] use_json                       = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] use_rootwrap_daemon            = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] use_stderr                     = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] use_syslog                     = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vcpu_pin_set                   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plugging_is_fatal          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plugging_timeout           = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] virt_mkfs                      = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] volume_usage_poll_interval     = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] watch_log_file                 = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] web                            = /usr/share/spice-html5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_concurrency.disable_process_locking = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.auth_strategy              = keystone {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.compute_link_prefix        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.dhcp_domain                = novalocal {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.enable_instance_password   = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.glance_link_prefix         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.instance_list_per_project_cells = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.list_records_by_skipping_down_cells = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.local_metadata_per_cell    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.max_limit                  = 1000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.metadata_cache_expiration  = 15 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.neutron_default_tenant_id  = default {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.use_forwarded_for          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.use_neutron_default_nets   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.vendordata_dynamic_targets = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.vendordata_jsonfile_path   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.backend_argument         = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.config_prefix            = cache.oslo {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.dead_timeout             = 60.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.debug_cache_backend      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.enable_retry_client      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.enable_socket_keepalive  = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.enabled                  = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.expiration_time          = 600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.hashclient_retry_attempts = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.memcache_dead_retry      = 300 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.memcache_password        =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.memcache_sasl_enabled    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.memcache_username        =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.proxies                  = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.retry_attempts           = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.retry_delay              = 0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.socket_keepalive_count   = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.socket_keepalive_idle    = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.socket_keepalive_interval = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.tls_allowed_ciphers      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.tls_cafile               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.tls_certfile             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.tls_enabled              = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cache.tls_keyfile              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.auth_section            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.auth_type               = password {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.cafile                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.certfile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.collect_timing          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.cross_az_attach         = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.debug                   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.endpoint_template       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.http_retries            = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.insecure                = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.keyfile                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.os_region_name          = RegionOne {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.split_loggers           = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cinder.timeout                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute.cpu_dedicated_set      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute.cpu_shared_set         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute.image_type_exclude_list = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute.resource_provider_association_refresh = 300 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute.shutdown_retry_interval = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] conductor.workers              = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] console.allowed_origins        = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] console.ssl_ciphers            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] console.ssl_minimum_version    = default {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] consoleauth.token_ttl          = 600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.cafile                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.certfile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.collect_timing          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.connect_retries         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.connect_retry_delay     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.endpoint_override       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.insecure                = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.keyfile                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.max_version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.min_version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.region_name             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.service_name            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.service_type            = accelerator {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.split_loggers           = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.status_code_retries     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.timeout                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] cyborg.version                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.backend               = sqlalchemy {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.connection            = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.connection_debug      = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.connection_parameters =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.connection_recycle_time = 3600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.connection_trace      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.db_inc_retry_interval = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.db_max_retries        = 20 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.db_max_retry_interval = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.db_retry_interval     = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.max_overflow          = 50 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.max_pool_size         = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.max_retries           = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.mysql_wsrep_sync_wait = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.pool_timeout          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.retry_interval        = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.slave_connection      = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] database.sqlite_synchronous    = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.backend           = sqlalchemy {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.connection        = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.connection_debug  = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.connection_parameters =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.connection_recycle_time = 3600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.connection_trace  = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.db_inc_retry_interval = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.db_max_retries    = 20 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.db_max_retry_interval = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.db_retry_interval = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.max_overflow      = 50 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.max_pool_size     = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.max_retries       = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.pool_timeout      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.retry_interval    = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.slave_connection  = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] api_database.sqlite_synchronous = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] devices.enabled_mdev_types     = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ephemeral_storage_encryption.enabled = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.api_servers             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.cafile                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.certfile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.collect_timing          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.connect_retries         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.connect_retry_delay     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.debug                   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.default_trusted_certificate_ids = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.enable_certificate_validation = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.enable_rbd_download     = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.endpoint_override       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.insecure                = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.keyfile                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.max_version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.min_version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.num_retries             = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.rbd_ceph_conf           =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.rbd_connect_timeout     = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.rbd_pool                =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.rbd_user                =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.region_name             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.service_name            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.service_type            = image {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.split_loggers           = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.status_code_retries     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.timeout                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.verify_glance_signatures = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] glance.version                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] guestfs.debug                  = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.config_drive_cdrom      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.config_drive_inject_password = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.enable_remotefx         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.instances_path_share    =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.limit_cpu_features      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.use_multipath_io        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.vswitch_name            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] mks.enabled                    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] image_cache.manager_interval   = 2400 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] image_cache.precache_concurrency = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] image_cache.remove_unused_base_images = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] image_cache.subdirectory_name  = _base {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.api_max_retries         = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.api_retry_interval      = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.auth_section            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.auth_type               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.cafile                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.certfile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.collect_timing          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.conductor_group         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.connect_retries         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.connect_retry_delay     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.endpoint_override       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.insecure                = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.keyfile                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.max_version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.min_version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.peer_list               = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.region_name             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.serial_console_state_timeout = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.service_name            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.service_type            = baremetal {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.split_loggers           = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.status_code_retries     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.timeout                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ironic.version                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] key_manager.fixed_key          = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.barbican_api_version  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.barbican_endpoint     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.barbican_endpoint_type = public {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.barbican_region_name  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.cafile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.certfile              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.collect_timing        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.insecure              = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.keyfile               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.number_of_retries     = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.retry_delay           = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.send_service_user_token = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.split_loggers         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.timeout               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.verify_ssl            = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican.verify_ssl_path       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican_service_user.auth_section = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican_service_user.auth_type = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican_service_user.cafile   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican_service_user.certfile = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican_service_user.collect_timing = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican_service_user.insecure = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican_service_user.keyfile  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican_service_user.split_loggers = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] barbican_service_user.timeout  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.approle_role_id          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.approle_secret_id        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.cafile                   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.certfile                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.collect_timing           = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.insecure                 = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.keyfile                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.kv_mountpoint            = secret {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.kv_path                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.kv_version               = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.namespace                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.root_token_id            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.split_loggers            = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.ssl_ca_crt_file          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.timeout                  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.use_ssl                  = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.auth_section          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.auth_type             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.cafile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.certfile              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.collect_timing        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.connect_retries       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.connect_retry_delay   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.endpoint_override     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.insecure              = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.keyfile               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.max_version           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.min_version           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.region_name           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.service_name          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.service_type          = identity {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.split_loggers         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.status_code_retries   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.timeout               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] keystone.version               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.connection_uri         =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.cpu_mode               = custom {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: WARNING oslo_config.cfg [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.cpu_power_governor_high = performance {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.cpu_power_management   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.device_detach_attempts = 8 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.device_detach_timeout  = 20 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.disk_cachemodes        = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.disk_prefix            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.enabled_perf_events    = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.file_backed_memory     = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.gid_maps               = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.hw_disk_discard        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.hw_machine_type        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.images_rbd_pool        = rbd {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.images_type            = default {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.images_volume_group    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.inject_key             = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.inject_partition       = -2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.inject_password        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.iscsi_iface            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.iser_use_multipath     = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_downtime = 500 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_inbound_addr = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_scheme  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_timeout_action = abort {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_tunnelled = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: WARNING oslo_config.cfg [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 13 17:15:11 user nova-compute[75100]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 13 17:15:11 user nova-compute[75100]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 13 17:15:11 user nova-compute[75100]: and ``live_migration_inbound_addr`` respectively.
Nov 13 17:15:11 user nova-compute[75100]: ).  Its value may be silently ignored in the future.
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.live_migration_with_native_tls = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.max_queues             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.nfs_mount_options      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.num_pcie_ports         = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.pmem_namespaces        = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.quobyte_client_cfg     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.rbd_secret_uuid        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.rbd_user               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.rescue_image_id        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.rescue_kernel_id       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.rx_queue_size          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.smbfs_mount_options    =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.snapshot_compression   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.snapshot_image_format  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.sparse_logical_volumes = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.swtpm_enabled          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.swtpm_group            = tss {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.swtpm_user             = tss {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.sysinfo_serial         = unique {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.tb_cache_size          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.tx_queue_size          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.uid_maps               = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.use_virtio_for_bridges = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.virt_type              = kvm {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.volume_clear           = zero {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.volume_clear_size      = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.volume_use_multipath   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.vzstorage_cache_path   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.auth_section           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.auth_type              = password {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.cafile                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.certfile               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.collect_timing         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.connect_retries        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.connect_retry_delay    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.default_floating_pool  = public {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.endpoint_override      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.extension_sync_interval = 600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.http_retries           = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.insecure               = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.keyfile                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.max_version            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.min_version            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.ovs_bridge             = br-int {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.physnets               = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.region_name            = RegionOne {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.service_metadata_proxy = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.service_name           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.service_type           = network {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.split_loggers          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.status_code_retries    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.timeout                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] neutron.version                = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] notifications.bdms_in_notifications = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] notifications.default_level    = INFO {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] notifications.notification_format = unversioned {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] notifications.notify_on_state_change = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] pci.alias                      = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] pci.device_spec                = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] pci.report_in_placement        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.auth_section         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.auth_type            = password {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.cafile               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.certfile             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.collect_timing       = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.connect_retries      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.connect_retry_delay  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.default_domain_id    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.default_domain_name  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.domain_id            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.domain_name          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.endpoint_override    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.insecure             = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.keyfile              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.max_version          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.min_version          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.password             = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.project_domain_id    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.project_domain_name  = Default {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.project_id           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.project_name         = service {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.region_name          = RegionOne {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.service_name         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.service_type         = placement {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.split_loggers        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.status_code_retries  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.system_scope         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.timeout              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.trust_id             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.user_domain_id       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.user_domain_name     = Default {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.user_id              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.username             = placement {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] placement.version              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.cores                    = 20 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.count_usage_from_placement = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.injected_file_content_bytes = 10240 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.injected_file_path_length = 255 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.injected_files           = 5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.instances                = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.key_pairs                = 100 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.metadata_items           = 128 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.ram                      = 51200 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.recheck_quota            = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.server_group_members     = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] quota.server_groups            = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] rdp.enabled                    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] scheduler.image_metadata_prefilter = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] scheduler.max_attempts         = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] scheduler.max_placement_results = 1000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] scheduler.workers              = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.host_subset_size = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.isolated_hosts = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.isolated_images = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.pci_in_placement = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.track_instance_changes = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] metrics.required               = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] metrics.weight_multiplier      = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] metrics.weight_setting         = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] serial_console.enabled         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] serial_console.port_range      = 10000:20000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] serial_console.serialproxy_port = 6083 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] service_user.auth_section      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] service_user.auth_type         = password {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] service_user.cafile            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] service_user.certfile          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] service_user.collect_timing    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] service_user.insecure          = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] service_user.keyfile           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] service_user.send_service_user_token = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] service_user.split_loggers     = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] service_user.timeout           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] spice.agent_enabled            = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] spice.enabled                  = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] spice.html5proxy_port          = 6082 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] spice.image_compression        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] spice.jpeg_compression         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] spice.playback_compression     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] spice.server_listen            = 127.0.0.1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] spice.streaming_mode           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] spice.zlib_compression         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] upgrade_levels.baseapi         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] upgrade_levels.cert            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] upgrade_levels.compute         = auto {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] upgrade_levels.conductor       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] upgrade_levels.scheduler       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vendordata_dynamic_auth.cafile = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vendordata_dynamic_auth.certfile = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vendordata_dynamic_auth.insecure = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vendordata_dynamic_auth.timeout = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.api_retry_count         = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.ca_file                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.cache_prefix            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.cluster_name            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.connection_pool_size    = 10 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.console_delay_seconds   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.datastore_regex         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.host_ip                 = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.host_password           = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.host_port               = 443 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.host_username           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.insecure                = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.integration_bridge      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.maximum_objects         = 100 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.pbm_default_policy      = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.pbm_enabled             = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.pbm_wsdl_location       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.serial_port_proxy_uri   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.serial_port_service_uri = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.task_poll_interval      = 0.5 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.use_linked_clone        = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.vnc_keymap              = en-us {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.vnc_port                = 5900 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vmware.vnc_port_total          = 10000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vnc.auth_schemes               = ['none'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vnc.enabled                    = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vnc.novncproxy_port            = 6080 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vnc.vencrypt_ca_certs          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vnc.vencrypt_client_cert       = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vnc.vencrypt_client_key        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.disable_rootwrap   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.enable_numa_live_migration = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.libvirt_disable_apic = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] wsgi.client_socket_timeout     = 900 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] wsgi.default_pool_size         = 1000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] wsgi.keep_alive                = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] wsgi.max_header_line           = 16384 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] wsgi.ssl_ca_file               = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] wsgi.ssl_cert_file             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] wsgi.ssl_key_file              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] wsgi.tcp_keepidle              = 600 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] zvm.ca_file                    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] zvm.cloud_connector_url        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] zvm.reachable_timeout          = 300 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_policy.enforce_new_defaults = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_policy.enforce_scope      = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_policy.policy_default_rule = default {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler.connection_string     = messaging:// {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler.enabled               = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler.es_doc_type           = notification {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler.es_scroll_size        = 10000 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler.es_scroll_time        = 2m {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler.filter_error_trace    = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler.hmac_keys             = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler.sentinel_service_name = mymaster {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler.socket_timeout        = 0.1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler.trace_requests        = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler.trace_sqlalchemy      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler_jaeger.process_tags   = {} {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler_jaeger.service_name_prefix = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] profiler_otlp.service_name_prefix = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] remote_debug.host              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] remote_debug.port              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_notifications.retry = -1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.auth_section        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.auth_type           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.cafile              = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.certfile            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.collect_timing      = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.connect_retries     = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.connect_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.endpoint_id         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.endpoint_override   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.insecure            = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.keyfile             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.max_version         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.min_version         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.region_name         = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.service_name        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.service_type        = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.split_loggers       = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.status_code_retries = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.status_code_retry_delay = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.timeout             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.valid_interfaces    = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_limit.version             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_reports.file_event_handler = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] oslo_reports.log_dir           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plug_ovs_privileged.group  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] vif_plug_ovs_privileged.user   = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_ovs.isolate_vif         = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] os_brick.lock_path             = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] privsep_osbrick.capabilities   = [21] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] privsep_osbrick.group          = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] privsep_osbrick.helper_command = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] privsep_osbrick.user           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] nova_sys_admin.group           = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] nova_sys_admin.helper_command  = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] nova_sys_admin.user            = None {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 17:15:11 user nova-compute[75100]: DEBUG oslo_service.service [None req-a3ab7e5d-1801-4f6f-bc9f-40ae9d8e9841 None None] ******************************************************************************** {{(pid=75100) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 13 17:15:11 user nova-compute[75100]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 13 17:15:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Connecting to libvirt: qemu:///system {{(pid=75100) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 13 17:15:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fda8045b040> {{(pid=75100) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 13 17:15:12 user nova-compute[75100]: libvirt:  error : internal error: could not initialize domain event timer
Nov 13 17:15:12 user nova-compute[75100]: WARNING nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 13 17:15:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fda8045b040> {{(pid=75100) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 13 17:15:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Starting native event thread {{(pid=75100) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 13 17:15:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Starting green dispatch thread {{(pid=75100) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 13 17:15:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Starting connection event dispatch thread {{(pid=75100) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 13 17:15:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Connection event '1' reason 'None'
Nov 13 17:15:12 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 13 17:15:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.mount [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Initialising _HostMountState generation 0 {{(pid=75100) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 13 17:15:19 user nova-compute[75100]: INFO nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Libvirt host capabilities <capabilities>
Nov 13 17:15:19 user nova-compute[75100]:   <host>
Nov 13 17:15:19 user nova-compute[75100]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 13 17:15:19 user nova-compute[75100]:     <cpu>
Nov 13 17:15:19 user nova-compute[75100]:       <arch>x86_64</arch>
Nov 13 17:15:19 user nova-compute[75100]:       <model>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 13 17:15:19 user nova-compute[75100]:       <microcode version='1070'/>
Nov 13 17:15:19 user nova-compute[75100]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 13 17:15:19 user nova-compute[75100]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='ss'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='vmx'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='pcid'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='osxsave'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='hypervisor'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='arat'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='tsc_adjust'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='md-clear'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='arch-capabilities'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='invtsc'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='rsba'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature name='skip-l1dfl-vmentry'/>
Nov 13 17:15:19 user nova-compute[75100]:       <pages unit='KiB' size='4'/>
Nov 13 17:15:19 user nova-compute[75100]:       <pages unit='KiB' size='2048'/>
Nov 13 17:15:19 user nova-compute[75100]:     </cpu>
Nov 13 17:15:19 user nova-compute[75100]:     <power_management>
Nov 13 17:15:19 user nova-compute[75100]:       <suspend_mem/>
Nov 13 17:15:19 user nova-compute[75100]:       <suspend_disk/>
Nov 13 17:15:19 user nova-compute[75100]:       <suspend_hybrid/>
Nov 13 17:15:19 user nova-compute[75100]:     </power_management>
Nov 13 17:15:19 user nova-compute[75100]:     <iommu support='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     <migration_features>
Nov 13 17:15:19 user nova-compute[75100]:       <live/>
Nov 13 17:15:19 user nova-compute[75100]:       <uri_transports>
Nov 13 17:15:19 user nova-compute[75100]:         <uri_transport>tcp</uri_transport>
Nov 13 17:15:19 user nova-compute[75100]:         <uri_transport>rdma</uri_transport>
Nov 13 17:15:19 user nova-compute[75100]:       </uri_transports>
Nov 13 17:15:19 user nova-compute[75100]:     </migration_features>
Nov 13 17:15:19 user nova-compute[75100]:     <topology>
Nov 13 17:15:19 user nova-compute[75100]:       <cells num='2'>
Nov 13 17:15:19 user nova-compute[75100]:         <cell id='0'>
Nov 13 17:15:19 user nova-compute[75100]:           <memory unit='KiB'>8140616</memory>
Nov 13 17:15:19 user nova-compute[75100]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 13 17:15:19 user nova-compute[75100]:           <pages unit='KiB' size='2048'>0</pages>
Nov 13 17:15:19 user nova-compute[75100]:           <distances>
Nov 13 17:15:19 user nova-compute[75100]:             <sibling id='0' value='10'/>
Nov 13 17:15:19 user nova-compute[75100]:             <sibling id='1' value='20'/>
Nov 13 17:15:19 user nova-compute[75100]:           </distances>
Nov 13 17:15:19 user nova-compute[75100]:           <cpus num='6'>
Nov 13 17:15:19 user nova-compute[75100]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 13 17:15:19 user nova-compute[75100]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 13 17:15:19 user nova-compute[75100]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 13 17:15:19 user nova-compute[75100]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 13 17:15:19 user nova-compute[75100]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 13 17:15:19 user nova-compute[75100]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 13 17:15:19 user nova-compute[75100]:           </cpus>
Nov 13 17:15:19 user nova-compute[75100]:         </cell>
Nov 13 17:15:19 user nova-compute[75100]:         <cell id='1'>
Nov 13 17:15:19 user nova-compute[75100]:           <memory unit='KiB'>8255100</memory>
Nov 13 17:15:19 user nova-compute[75100]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 13 17:15:19 user nova-compute[75100]:           <pages unit='KiB' size='2048'>0</pages>
Nov 13 17:15:19 user nova-compute[75100]:           <distances>
Nov 13 17:15:19 user nova-compute[75100]:             <sibling id='0' value='20'/>
Nov 13 17:15:19 user nova-compute[75100]:             <sibling id='1' value='10'/>
Nov 13 17:15:19 user nova-compute[75100]:           </distances>
Nov 13 17:15:19 user nova-compute[75100]:           <cpus num='6'>
Nov 13 17:15:19 user nova-compute[75100]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 13 17:15:19 user nova-compute[75100]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 13 17:15:19 user nova-compute[75100]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 13 17:15:19 user nova-compute[75100]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 13 17:15:19 user nova-compute[75100]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 13 17:15:19 user nova-compute[75100]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 13 17:15:19 user nova-compute[75100]:           </cpus>
Nov 13 17:15:19 user nova-compute[75100]:         </cell>
Nov 13 17:15:19 user nova-compute[75100]:       </cells>
Nov 13 17:15:19 user nova-compute[75100]:     </topology>
Nov 13 17:15:19 user nova-compute[75100]:     <cache>
Nov 13 17:15:19 user nova-compute[75100]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 13 17:15:19 user nova-compute[75100]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 13 17:15:19 user nova-compute[75100]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 13 17:15:19 user nova-compute[75100]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 13 17:15:19 user nova-compute[75100]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 13 17:15:19 user nova-compute[75100]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 13 17:15:19 user nova-compute[75100]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 13 17:15:19 user nova-compute[75100]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 13 17:15:19 user nova-compute[75100]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 13 17:15:19 user nova-compute[75100]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 13 17:15:19 user nova-compute[75100]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 13 17:15:19 user nova-compute[75100]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 13 17:15:19 user nova-compute[75100]:     </cache>
Nov 13 17:15:19 user nova-compute[75100]:     <secmodel>
Nov 13 17:15:19 user nova-compute[75100]:       <model>apparmor</model>
Nov 13 17:15:19 user nova-compute[75100]:       <doi>0</doi>
Nov 13 17:15:19 user nova-compute[75100]:     </secmodel>
Nov 13 17:15:19 user nova-compute[75100]:     <secmodel>
Nov 13 17:15:19 user nova-compute[75100]:       <model>dac</model>
Nov 13 17:15:19 user nova-compute[75100]:       <doi>0</doi>
Nov 13 17:15:19 user nova-compute[75100]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 13 17:15:19 user nova-compute[75100]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 13 17:15:19 user nova-compute[75100]:     </secmodel>
Nov 13 17:15:19 user nova-compute[75100]:   </host>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='alpha'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>clipper</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='armv6l'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>spitz</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>nuri</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>kzm</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sx1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>z2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>tosa</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>n810</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>n800</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>terrier</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>midway</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>microbit</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>verdex</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>highbank</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>akita</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>connex</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>collie</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='armv7l'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>spitz</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>nuri</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>kzm</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sx1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>z2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>tosa</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>n810</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>n800</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>terrier</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>midway</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>microbit</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>verdex</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>highbank</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>akita</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>connex</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>collie</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='aarch64'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>spitz</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>nuri</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>kzm</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sx1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>z2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>tosa</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>n810</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>n800</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>terrier</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>midway</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>microbit</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>verdex</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>raspi3b</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>highbank</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>akita</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>connex</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>collie</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <acpi default='on' toggle='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='cris'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='i686'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>x-remote</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>isapc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>microvm</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='kvm'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <pae/>
Nov 13 17:15:19 user nova-compute[75100]:       <nonpae/>
Nov 13 17:15:19 user nova-compute[75100]:       <acpi default='on' toggle='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:       <apic default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='m68k'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>an5206</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>q800</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>next-cube</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='microblaze'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='microblazeel'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='mips'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='16'>malta</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='mipsel'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='16'>malta</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='mips64'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='16'>malta</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>pica61</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>magnum</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='mips64el'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='16'>malta</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>pica61</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>magnum</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='16'>boston</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='ppc'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mac99</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>40p</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>taihu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='ppc64'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2048'>powernv9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>taihu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2048'>powernv10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>40p</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mac99</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2048'>powernv8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='ppc64le'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2048'>powernv9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>taihu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2048'>powernv10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>40p</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>mac99</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2048'>powernv8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='riscv32'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='8'>spike</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>opentitan</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='5'>sifive_u</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sifive_e</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='8'>virt</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='riscv64'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='8'>spike</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='5'>sifive_u</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>shakti_c</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sifive_e</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='8'>virt</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='s390x'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='sh4'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>shix</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>r2d</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='sh4eb'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>shix</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>r2d</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='sparc'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>SS-5</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>SS-20</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>LX</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>SS-4</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>SS-10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>Voyager</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='sparc64'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sun4u</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>niagara</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>sun4v</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='x86_64'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>64</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>x-remote</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='1'>isapc</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>microvm</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='kvm'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <acpi default='on' toggle='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:       <apic default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='xtensa'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>sim</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>kc705</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>ml605</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>virt</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>lx200</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>lx60</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]:   <guest>
Nov 13 17:15:19 user nova-compute[75100]:     <os_type>hvm</os_type>
Nov 13 17:15:19 user nova-compute[75100]:     <arch name='xtensaeb'>
Nov 13 17:15:19 user nova-compute[75100]:       <wordsize>32</wordsize>
Nov 13 17:15:19 user nova-compute[75100]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='4'>sim</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>kc705</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>ml605</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>virt</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>lx200</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>lx60</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 13 17:15:19 user nova-compute[75100]:       <domain type='qemu'/>
Nov 13 17:15:19 user nova-compute[75100]:     </arch>
Nov 13 17:15:19 user nova-compute[75100]:     <features>
Nov 13 17:15:19 user nova-compute[75100]:       <cpuselection/>
Nov 13 17:15:19 user nova-compute[75100]:       <deviceboot/>
Nov 13 17:15:19 user nova-compute[75100]:       <disksnapshot default='on' toggle='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     </features>
Nov 13 17:15:19 user nova-compute[75100]:   </guest>
Nov 13 17:15:19 user nova-compute[75100]: </capabilities>
Nov 13 17:15:19 user nova-compute[75100]: 
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 13 17:15:19 user nova-compute[75100]: <domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 17:15:19 user nova-compute[75100]:   <domain>kvm</domain>
Nov 13 17:15:19 user nova-compute[75100]:   <machine>pc-i440fx-jammy</machine>
Nov 13 17:15:19 user nova-compute[75100]:   <arch>i686</arch>
Nov 13 17:15:19 user nova-compute[75100]:   <vcpu max='255'/>
Nov 13 17:15:19 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:   <os supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='firmware'/>
Nov 13 17:15:19 user nova-compute[75100]:     <loader supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>rom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pflash</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='readonly'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>yes</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='secure'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </loader>
Nov 13 17:15:19 user nova-compute[75100]:   </os>
Nov 13 17:15:19 user nova-compute[75100]:   <cpu>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>on</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='lm'/>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>kvm64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>core2duo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Westmere</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Penryn</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G1</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Nehalem</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Conroe</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:   </cpu>
Nov 13 17:15:19 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='sourceType'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>file</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>anonymous</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>memfd</value>
Nov 13 17:15:19 user nova-compute[75100]:     </enum>
Nov 13 17:15:19 user nova-compute[75100]:   </memoryBacking>
Nov 13 17:15:19 user nova-compute[75100]:   <devices>
Nov 13 17:15:19 user nova-compute[75100]:     <disk supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>disk</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cdrom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>floppy</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>lun</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='bus'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>ide</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>fdc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sata</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </disk>
Nov 13 17:15:19 user nova-compute[75100]:     <graphics supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sdl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vnc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>spice</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egl-headless</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </graphics>
Nov 13 17:15:19 user nova-compute[75100]:     <video supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='modelType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cirrus</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vmvga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>qxl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>none</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>bochs</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>ramfb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </video>
Nov 13 17:15:19 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='mode'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>subsystem</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>default</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>mandatory</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>requisite</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>optional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='subsysType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pci</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='capsType'/>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 13 17:15:19 user nova-compute[75100]:     </hostdev>
Nov 13 17:15:19 user nova-compute[75100]:     <rng supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>random</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egd</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>builtin</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </rng>
Nov 13 17:15:19 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='driverType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>path</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>handle</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtiofs</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </filesystem>
Nov 13 17:15:19 user nova-compute[75100]:     <tpm supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>passthrough</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>emulator</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </tpm>
Nov 13 17:15:19 user nova-compute[75100]:   </devices>
Nov 13 17:15:19 user nova-compute[75100]:   <features>
Nov 13 17:15:19 user nova-compute[75100]:     <gic supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <genid supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backup supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <sev supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:   </features>
Nov 13 17:15:19 user nova-compute[75100]: </domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 13 17:15:19 user nova-compute[75100]: <domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 17:15:19 user nova-compute[75100]:   <domain>kvm</domain>
Nov 13 17:15:19 user nova-compute[75100]:   <machine>pc-i440fx-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:   <arch>i686</arch>
Nov 13 17:15:19 user nova-compute[75100]:   <vcpu max='255'/>
Nov 13 17:15:19 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:   <os supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='firmware'/>
Nov 13 17:15:19 user nova-compute[75100]:     <loader supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>rom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pflash</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='readonly'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>yes</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='secure'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </loader>
Nov 13 17:15:19 user nova-compute[75100]:   </os>
Nov 13 17:15:19 user nova-compute[75100]:   <cpu>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>on</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='lm'/>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>kvm64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>core2duo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Westmere</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Penryn</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G1</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Nehalem</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Conroe</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:   </cpu>
Nov 13 17:15:19 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='sourceType'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>file</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>anonymous</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>memfd</value>
Nov 13 17:15:19 user nova-compute[75100]:     </enum>
Nov 13 17:15:19 user nova-compute[75100]:   </memoryBacking>
Nov 13 17:15:19 user nova-compute[75100]:   <devices>
Nov 13 17:15:19 user nova-compute[75100]:     <disk supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>disk</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cdrom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>floppy</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>lun</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='bus'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>ide</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>fdc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sata</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </disk>
Nov 13 17:15:19 user nova-compute[75100]:     <graphics supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sdl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vnc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>spice</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egl-headless</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </graphics>
Nov 13 17:15:19 user nova-compute[75100]:     <video supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='modelType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cirrus</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vmvga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>qxl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>none</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>bochs</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>ramfb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </video>
Nov 13 17:15:19 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='mode'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>subsystem</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>default</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>mandatory</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>requisite</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>optional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='subsysType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pci</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='capsType'/>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 13 17:15:19 user nova-compute[75100]:     </hostdev>
Nov 13 17:15:19 user nova-compute[75100]:     <rng supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>random</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egd</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>builtin</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </rng>
Nov 13 17:15:19 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='driverType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>path</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>handle</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtiofs</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </filesystem>
Nov 13 17:15:19 user nova-compute[75100]:     <tpm supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>passthrough</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>emulator</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </tpm>
Nov 13 17:15:19 user nova-compute[75100]:   </devices>
Nov 13 17:15:19 user nova-compute[75100]:   <features>
Nov 13 17:15:19 user nova-compute[75100]:     <gic supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <genid supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backup supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <sev supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:   </features>
Nov 13 17:15:19 user nova-compute[75100]: </domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 13 17:15:19 user nova-compute[75100]: <domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 17:15:19 user nova-compute[75100]:   <domain>kvm</domain>
Nov 13 17:15:19 user nova-compute[75100]:   <machine>pc-q35-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:   <arch>i686</arch>
Nov 13 17:15:19 user nova-compute[75100]:   <vcpu max='288'/>
Nov 13 17:15:19 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:   <os supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='firmware'/>
Nov 13 17:15:19 user nova-compute[75100]:     <loader supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>rom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pflash</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='readonly'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>yes</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='secure'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </loader>
Nov 13 17:15:19 user nova-compute[75100]:   </os>
Nov 13 17:15:19 user nova-compute[75100]:   <cpu>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>on</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='lm'/>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>kvm64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>core2duo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Westmere</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Penryn</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G1</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Nehalem</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Conroe</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:   </cpu>
Nov 13 17:15:19 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='sourceType'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>file</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>anonymous</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>memfd</value>
Nov 13 17:15:19 user nova-compute[75100]:     </enum>
Nov 13 17:15:19 user nova-compute[75100]:   </memoryBacking>
Nov 13 17:15:19 user nova-compute[75100]:   <devices>
Nov 13 17:15:19 user nova-compute[75100]:     <disk supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>disk</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cdrom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>floppy</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>lun</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='bus'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>fdc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sata</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </disk>
Nov 13 17:15:19 user nova-compute[75100]:     <graphics supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sdl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vnc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>spice</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egl-headless</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </graphics>
Nov 13 17:15:19 user nova-compute[75100]:     <video supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='modelType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cirrus</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vmvga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>qxl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>none</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>bochs</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>ramfb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </video>
Nov 13 17:15:19 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='mode'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>subsystem</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>default</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>mandatory</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>requisite</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>optional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='subsysType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pci</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='capsType'/>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 13 17:15:19 user nova-compute[75100]:     </hostdev>
Nov 13 17:15:19 user nova-compute[75100]:     <rng supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>random</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egd</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>builtin</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </rng>
Nov 13 17:15:19 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='driverType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>path</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>handle</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtiofs</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </filesystem>
Nov 13 17:15:19 user nova-compute[75100]:     <tpm supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>passthrough</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>emulator</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </tpm>
Nov 13 17:15:19 user nova-compute[75100]:   </devices>
Nov 13 17:15:19 user nova-compute[75100]:   <features>
Nov 13 17:15:19 user nova-compute[75100]:     <gic supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <genid supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backup supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <sev supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:   </features>
Nov 13 17:15:19 user nova-compute[75100]: </domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 13 17:15:19 user nova-compute[75100]: <domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 17:15:19 user nova-compute[75100]:   <domain>kvm</domain>
Nov 13 17:15:19 user nova-compute[75100]:   <machine>pc-q35-jammy</machine>
Nov 13 17:15:19 user nova-compute[75100]:   <arch>i686</arch>
Nov 13 17:15:19 user nova-compute[75100]:   <vcpu max='288'/>
Nov 13 17:15:19 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:   <os supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='firmware'/>
Nov 13 17:15:19 user nova-compute[75100]:     <loader supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>rom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pflash</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='readonly'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>yes</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='secure'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </loader>
Nov 13 17:15:19 user nova-compute[75100]:   </os>
Nov 13 17:15:19 user nova-compute[75100]:   <cpu>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>on</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='lm'/>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>kvm64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>core2duo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Westmere</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Penryn</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G1</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Nehalem</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Conroe</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:   </cpu>
Nov 13 17:15:19 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='sourceType'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>file</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>anonymous</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>memfd</value>
Nov 13 17:15:19 user nova-compute[75100]:     </enum>
Nov 13 17:15:19 user nova-compute[75100]:   </memoryBacking>
Nov 13 17:15:19 user nova-compute[75100]:   <devices>
Nov 13 17:15:19 user nova-compute[75100]:     <disk supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>disk</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cdrom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>floppy</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>lun</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='bus'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>fdc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sata</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </disk>
Nov 13 17:15:19 user nova-compute[75100]:     <graphics supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sdl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vnc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>spice</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egl-headless</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </graphics>
Nov 13 17:15:19 user nova-compute[75100]:     <video supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='modelType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cirrus</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vmvga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>qxl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>none</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>bochs</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>ramfb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </video>
Nov 13 17:15:19 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='mode'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>subsystem</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>default</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>mandatory</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>requisite</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>optional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='subsysType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pci</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='capsType'/>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 13 17:15:19 user nova-compute[75100]:     </hostdev>
Nov 13 17:15:19 user nova-compute[75100]:     <rng supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>random</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egd</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>builtin</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </rng>
Nov 13 17:15:19 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='driverType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>path</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>handle</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtiofs</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </filesystem>
Nov 13 17:15:19 user nova-compute[75100]:     <tpm supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>passthrough</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>emulator</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </tpm>
Nov 13 17:15:19 user nova-compute[75100]:   </devices>
Nov 13 17:15:19 user nova-compute[75100]:   <features>
Nov 13 17:15:19 user nova-compute[75100]:     <gic supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <genid supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backup supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <sev supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:   </features>
Nov 13 17:15:19 user nova-compute[75100]: </domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 13 17:15:19 user nova-compute[75100]: <domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 17:15:19 user nova-compute[75100]:   <domain>kvm</domain>
Nov 13 17:15:19 user nova-compute[75100]:   <machine>pc-i440fx-jammy</machine>
Nov 13 17:15:19 user nova-compute[75100]:   <arch>x86_64</arch>
Nov 13 17:15:19 user nova-compute[75100]:   <vcpu max='255'/>
Nov 13 17:15:19 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:   <os supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='firmware'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>efi</value>
Nov 13 17:15:19 user nova-compute[75100]:     </enum>
Nov 13 17:15:19 user nova-compute[75100]:     <loader supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>rom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pflash</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='readonly'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>yes</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='secure'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </loader>
Nov 13 17:15:19 user nova-compute[75100]:   </os>
Nov 13 17:15:19 user nova-compute[75100]:   <cpu>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>on</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>on</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='invtsc'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='rsba'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>kvm64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>core2duo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Westmere</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Penryn</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Opteron_G1</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Nehalem</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Conroe</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:   </cpu>
Nov 13 17:15:19 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='sourceType'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>file</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>anonymous</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>memfd</value>
Nov 13 17:15:19 user nova-compute[75100]:     </enum>
Nov 13 17:15:19 user nova-compute[75100]:   </memoryBacking>
Nov 13 17:15:19 user nova-compute[75100]:   <devices>
Nov 13 17:15:19 user nova-compute[75100]:     <disk supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>disk</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cdrom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>floppy</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>lun</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='bus'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>ide</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>fdc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sata</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </disk>
Nov 13 17:15:19 user nova-compute[75100]:     <graphics supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sdl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vnc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>spice</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egl-headless</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </graphics>
Nov 13 17:15:19 user nova-compute[75100]:     <video supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='modelType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cirrus</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vmvga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>qxl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>none</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>bochs</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>ramfb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </video>
Nov 13 17:15:19 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='mode'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>subsystem</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>default</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>mandatory</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>requisite</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>optional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='subsysType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pci</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='capsType'/>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 13 17:15:19 user nova-compute[75100]:     </hostdev>
Nov 13 17:15:19 user nova-compute[75100]:     <rng supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>random</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egd</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>builtin</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </rng>
Nov 13 17:15:19 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='driverType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>path</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>handle</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtiofs</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </filesystem>
Nov 13 17:15:19 user nova-compute[75100]:     <tpm supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>passthrough</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>emulator</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </tpm>
Nov 13 17:15:19 user nova-compute[75100]:   </devices>
Nov 13 17:15:19 user nova-compute[75100]:   <features>
Nov 13 17:15:19 user nova-compute[75100]:     <gic supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <genid supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backup supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <sev supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:   </features>
Nov 13 17:15:19 user nova-compute[75100]: </domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 13 17:15:19 user nova-compute[75100]: <domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 17:15:19 user nova-compute[75100]:   <domain>kvm</domain>
Nov 13 17:15:19 user nova-compute[75100]:   <machine>pc-i440fx-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:   <arch>x86_64</arch>
Nov 13 17:15:19 user nova-compute[75100]:   <vcpu max='255'/>
Nov 13 17:15:19 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:   <os supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='firmware'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>efi</value>
Nov 13 17:15:19 user nova-compute[75100]:     </enum>
Nov 13 17:15:19 user nova-compute[75100]:     <loader supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>rom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pflash</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='readonly'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>yes</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='secure'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </loader>
Nov 13 17:15:19 user nova-compute[75100]:   </os>
Nov 13 17:15:19 user nova-compute[75100]:   <cpu>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>on</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>on</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='invtsc'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='rsba'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>kvm64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>core2duo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Westmere</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Penryn</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Opteron_G1</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Nehalem</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Conroe</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:   </cpu>
Nov 13 17:15:19 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='sourceType'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>file</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>anonymous</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>memfd</value>
Nov 13 17:15:19 user nova-compute[75100]:     </enum>
Nov 13 17:15:19 user nova-compute[75100]:   </memoryBacking>
Nov 13 17:15:19 user nova-compute[75100]:   <devices>
Nov 13 17:15:19 user nova-compute[75100]:     <disk supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>disk</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cdrom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>floppy</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>lun</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='bus'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>ide</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>fdc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sata</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </disk>
Nov 13 17:15:19 user nova-compute[75100]:     <graphics supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sdl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vnc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>spice</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egl-headless</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </graphics>
Nov 13 17:15:19 user nova-compute[75100]:     <video supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='modelType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cirrus</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vmvga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>qxl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>none</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>bochs</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>ramfb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </video>
Nov 13 17:15:19 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='mode'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>subsystem</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>default</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>mandatory</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>requisite</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>optional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='subsysType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pci</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='capsType'/>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 13 17:15:19 user nova-compute[75100]:     </hostdev>
Nov 13 17:15:19 user nova-compute[75100]:     <rng supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>random</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egd</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>builtin</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </rng>
Nov 13 17:15:19 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='driverType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>path</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>handle</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtiofs</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </filesystem>
Nov 13 17:15:19 user nova-compute[75100]:     <tpm supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>passthrough</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>emulator</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </tpm>
Nov 13 17:15:19 user nova-compute[75100]:   </devices>
Nov 13 17:15:19 user nova-compute[75100]:   <features>
Nov 13 17:15:19 user nova-compute[75100]:     <gic supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <genid supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backup supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <sev supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:   </features>
Nov 13 17:15:19 user nova-compute[75100]: </domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 13 17:15:19 user nova-compute[75100]: <domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 17:15:19 user nova-compute[75100]:   <domain>kvm</domain>
Nov 13 17:15:19 user nova-compute[75100]:   <machine>pc-q35-6.2</machine>
Nov 13 17:15:19 user nova-compute[75100]:   <arch>x86_64</arch>
Nov 13 17:15:19 user nova-compute[75100]:   <vcpu max='288'/>
Nov 13 17:15:19 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:   <os supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='firmware'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>efi</value>
Nov 13 17:15:19 user nova-compute[75100]:     </enum>
Nov 13 17:15:19 user nova-compute[75100]:     <loader supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>rom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pflash</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='readonly'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>yes</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='secure'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>yes</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </loader>
Nov 13 17:15:19 user nova-compute[75100]:   </os>
Nov 13 17:15:19 user nova-compute[75100]:   <cpu>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>on</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>on</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='invtsc'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='rsba'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>kvm64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>core2duo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Westmere</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Penryn</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Opteron_G1</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Nehalem</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Conroe</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:   </cpu>
Nov 13 17:15:19 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='sourceType'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>file</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>anonymous</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>memfd</value>
Nov 13 17:15:19 user nova-compute[75100]:     </enum>
Nov 13 17:15:19 user nova-compute[75100]:   </memoryBacking>
Nov 13 17:15:19 user nova-compute[75100]:   <devices>
Nov 13 17:15:19 user nova-compute[75100]:     <disk supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>disk</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cdrom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>floppy</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>lun</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='bus'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>fdc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sata</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </disk>
Nov 13 17:15:19 user nova-compute[75100]:     <graphics supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sdl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vnc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>spice</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egl-headless</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </graphics>
Nov 13 17:15:19 user nova-compute[75100]:     <video supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='modelType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cirrus</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vmvga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>qxl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>none</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>bochs</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>ramfb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </video>
Nov 13 17:15:19 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='mode'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>subsystem</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>default</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>mandatory</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>requisite</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>optional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='subsysType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pci</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='capsType'/>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 13 17:15:19 user nova-compute[75100]:     </hostdev>
Nov 13 17:15:19 user nova-compute[75100]:     <rng supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>random</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egd</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>builtin</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </rng>
Nov 13 17:15:19 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='driverType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>path</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>handle</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtiofs</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </filesystem>
Nov 13 17:15:19 user nova-compute[75100]:     <tpm supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>passthrough</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>emulator</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </tpm>
Nov 13 17:15:19 user nova-compute[75100]:   </devices>
Nov 13 17:15:19 user nova-compute[75100]:   <features>
Nov 13 17:15:19 user nova-compute[75100]:     <gic supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <genid supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backup supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <sev supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:   </features>
Nov 13 17:15:19 user nova-compute[75100]: </domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 13 17:15:19 user nova-compute[75100]: <domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 17:15:19 user nova-compute[75100]:   <domain>kvm</domain>
Nov 13 17:15:19 user nova-compute[75100]:   <machine>pc-q35-jammy</machine>
Nov 13 17:15:19 user nova-compute[75100]:   <arch>x86_64</arch>
Nov 13 17:15:19 user nova-compute[75100]:   <vcpu max='288'/>
Nov 13 17:15:19 user nova-compute[75100]:   <iothreads supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:   <os supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='firmware'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>efi</value>
Nov 13 17:15:19 user nova-compute[75100]:     </enum>
Nov 13 17:15:19 user nova-compute[75100]:     <loader supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>rom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pflash</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='readonly'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>yes</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='secure'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>yes</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>no</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </loader>
Nov 13 17:15:19 user nova-compute[75100]:   </os>
Nov 13 17:15:19 user nova-compute[75100]:   <cpu>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-passthrough' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='hostPassthroughMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>on</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='maximum' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='maximumMigratable'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>on</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>off</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='host-model' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <vendor>Intel</vendor>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ss'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='vmx'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='pcid'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='hypervisor'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arat'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='umip'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='md-clear'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='invtsc'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibpb'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='ibrs'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-stibp'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='rsba'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='erms'/>
Nov 13 17:15:19 user nova-compute[75100]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:     <mode name='custom' supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>qemu64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>qemu32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>phenom</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>pentium</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>n270</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>kvm64</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>kvm32</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>coreduo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>core2duo</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>athlon</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Westmere</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Snowridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Skylake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>SandyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Penryn</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G5</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G4</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G3</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Opteron_G2</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Opteron_G1</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Nehalem</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>IvyBridge</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Icelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Haswell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Rome</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-Milan</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>EPYC</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Dhyana</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cooperlake</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>Conroe</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='no'>Broadwell</model>
Nov 13 17:15:19 user nova-compute[75100]:       <model usable='yes'>486</model>
Nov 13 17:15:19 user nova-compute[75100]:     </mode>
Nov 13 17:15:19 user nova-compute[75100]:   </cpu>
Nov 13 17:15:19 user nova-compute[75100]:   <memoryBacking supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:     <enum name='sourceType'>
Nov 13 17:15:19 user nova-compute[75100]:       <value>file</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>anonymous</value>
Nov 13 17:15:19 user nova-compute[75100]:       <value>memfd</value>
Nov 13 17:15:19 user nova-compute[75100]:     </enum>
Nov 13 17:15:19 user nova-compute[75100]:   </memoryBacking>
Nov 13 17:15:19 user nova-compute[75100]:   <devices>
Nov 13 17:15:19 user nova-compute[75100]:     <disk supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='diskDevice'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>disk</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cdrom</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>floppy</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>lun</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='bus'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>fdc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sata</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </disk>
Nov 13 17:15:19 user nova-compute[75100]:     <graphics supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='type'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>sdl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vnc</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>spice</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egl-headless</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </graphics>
Nov 13 17:15:19 user nova-compute[75100]:     <video supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='modelType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>cirrus</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>vmvga</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>qxl</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>none</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>bochs</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>ramfb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </video>
Nov 13 17:15:19 user nova-compute[75100]:     <hostdev supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='mode'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>subsystem</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='startupPolicy'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>default</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>mandatory</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>requisite</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>optional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='subsysType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>usb</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>pci</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>scsi</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='capsType'/>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='pciBackend'/>
Nov 13 17:15:19 user nova-compute[75100]:     </hostdev>
Nov 13 17:15:19 user nova-compute[75100]:     <rng supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtio-non-transitional</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>random</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>egd</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>builtin</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </rng>
Nov 13 17:15:19 user nova-compute[75100]:     <filesystem supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='driverType'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>path</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>handle</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>virtiofs</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </filesystem>
Nov 13 17:15:19 user nova-compute[75100]:     <tpm supported='yes'>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='model'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-tis</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>tpm-crb</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:       <enum name='backendModel'>
Nov 13 17:15:19 user nova-compute[75100]:         <value>passthrough</value>
Nov 13 17:15:19 user nova-compute[75100]:         <value>emulator</value>
Nov 13 17:15:19 user nova-compute[75100]:       </enum>
Nov 13 17:15:19 user nova-compute[75100]:     </tpm>
Nov 13 17:15:19 user nova-compute[75100]:   </devices>
Nov 13 17:15:19 user nova-compute[75100]:   <features>
Nov 13 17:15:19 user nova-compute[75100]:     <gic supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:     <vmcoreinfo supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <genid supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backingStoreInput supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <backup supported='yes'/>
Nov 13 17:15:19 user nova-compute[75100]:     <sev supported='no'/>
Nov 13 17:15:19 user nova-compute[75100]:   </features>
Nov 13 17:15:19 user nova-compute[75100]: </domainCapabilities>
Nov 13 17:15:19 user nova-compute[75100]:  {{(pid=75100) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75100) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75100) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Checking secure boot support for host arch (x86_64) {{(pid=75100) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Checking secure boot support for host arch (x86_64) {{(pid=75100) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Checking secure boot support for host arch (x86_64) {{(pid=75100) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Checking secure boot support for host arch (x86_64) {{(pid=75100) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Checking secure boot support for host arch (x86_64) {{(pid=75100) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 13 17:15:19 user nova-compute[75100]: INFO nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Secure Boot support detected
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] cpu compare xml: <cpu match="exact">
Nov 13 17:15:19 user nova-compute[75100]:   <model>Nehalem</model>
Nov 13 17:15:19 user nova-compute[75100]: </cpu>
Nov 13 17:15:19 user nova-compute[75100]:  {{(pid=75100) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 13 17:15:19 user nova-compute[75100]: INFO nova.virt.node [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Generated node identity d0cd9ee7-47c1-40a1-b685-446f6384b590
Nov 13 17:15:19 user nova-compute[75100]: INFO nova.virt.node [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Wrote node identity d0cd9ee7-47c1-40a1-b685-446f6384b590 to /opt/stack/data/nova/compute_id
Nov 13 17:15:19 user nova-compute[75100]: WARNING nova.compute.manager [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Compute nodes ['d0cd9ee7-47c1-40a1-b685-446f6384b590'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 13 17:15:19 user nova-compute[75100]: INFO nova.compute.manager [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 13 17:15:19 user nova-compute[75100]: WARNING nova.compute.manager [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 13 17:15:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:15:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:15:20 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:15:20 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Hypervisor/Node resource view: name=user free_ram=10940MB free_disk=26.12871551513672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:15:20 user nova-compute[75100]: WARNING nova.compute.resource_tracker [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] No compute node record for user:d0cd9ee7-47c1-40a1-b685-446f6384b590: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host d0cd9ee7-47c1-40a1-b685-446f6384b590 could not be found.
Nov 13 17:15:20 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Compute node record created for user:user with uuid: d0cd9ee7-47c1-40a1-b685-446f6384b590
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:15:20 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] [req-8255d2dc-a907-4810-86eb-ef36767d48b1] Created resource provider record via placement API for resource provider with UUID d0cd9ee7-47c1-40a1-b685-446f6384b590 and name user.
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75100) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 13 17:15:20 user nova-compute[75100]: INFO nova.virt.libvirt.host [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] kernel doesn't support AMD SEV
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Updating inventory in ProviderTree for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Libvirt baseline CPU <cpu>
Nov 13 17:15:20 user nova-compute[75100]:   <arch>x86_64</arch>
Nov 13 17:15:20 user nova-compute[75100]:   <model>Nehalem</model>
Nov 13 17:15:20 user nova-compute[75100]:   <vendor>Intel</vendor>
Nov 13 17:15:20 user nova-compute[75100]:   <topology sockets="6" cores="1" threads="1"/>
Nov 13 17:15:20 user nova-compute[75100]: </cpu>
Nov 13 17:15:20 user nova-compute[75100]:  {{(pid=75100) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Updated inventory for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Updating resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590 generation from 0 to 1 during operation: update_inventory {{(pid=75100) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Updating inventory in ProviderTree for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Updating resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590 generation from 1 to 2 during operation: update_traits {{(pid=75100) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.739s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.service [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Creating RPC server for service compute {{(pid=75100) start /opt/stack/nova/nova/service.py:182}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.service [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] Join ServiceGroup membership for this service compute {{(pid=75100) start /opt/stack/nova/nova/service.py:199}}
Nov 13 17:15:20 user nova-compute[75100]: DEBUG nova.servicegroup.drivers.db [None req-5014ff42-bc8b-4b92-ac9a-efce2eb33072 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75100) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 13 17:16:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:16:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:16:11 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:16:11 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:16:11 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=10378MB free_disk=26.03249740600586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:16:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:17:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:17:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:17:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:17:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:17:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 17:17:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:17:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:17:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:17:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:17:13 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:17:13 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:17:13 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=10315MB free_disk=26.096858978271484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:17:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:18:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:18:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:18:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:18:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:18:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:18:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:18:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 17:18:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:18:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:18:14 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:18:14 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:18:14 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=10297MB free_disk=25.849376678466797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:18:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:18:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:18:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:18:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:19:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:19:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:19:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:19:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:19:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:19:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:19:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:19:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:19:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:19:16 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:16 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=9592MB free_disk=25.8773193359375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:19:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:19:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "31779592-a9f2-4aae-a658-e055ec832b37" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "31779592-a9f2-4aae-a658-e055ec832b37" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:19:21 user nova-compute[75100]: INFO nova.compute.claims [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Claim successful on node user
Nov 13 17:19:21 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:19:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:19:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:19:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:19:22 user nova-compute[75100]: INFO nova.compute.claims [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Claim successful on node user
Nov 13 17:19:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:19:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Creating image(s)
Nov 13 17:19:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "/opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "/opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "/opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.278s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:19:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:19:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:19:22 user nova-compute[75100]: DEBUG nova.policy [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb423a49f7954aa29f976f2f5d0e27ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46e9dffd99824724a921a72499143852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG nova.policy [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33657093c7ab4112994a1b7e997cfb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c1d1cfd844465e85239be73eb73cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:19:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Creating image(s)
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "/opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "/opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "/opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG nova.virt.images [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] 40ac832f-026d-4a87-87c5-ec47fa8f4825 was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9.part /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9.part /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9.converted" returned: 0 in 0.157s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.382s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:23 user nova-compute[75100]: INFO oslo.privsep.daemon [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp23d2j_pf/privsep.sock']
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.378s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:23 user sudo[84359]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp23d2j_pf/privsep.sock
Nov 13 17:19:23 user sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 17:19:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:19:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:19:24 user nova-compute[75100]: INFO nova.compute.claims [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Claim successful on node user
Nov 13 17:19:24 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:19:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:19:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:19:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:19:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:19:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:19:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:19:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Creating image(s)
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "/opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "/opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:25 user sudo[84359]: pam_unix(sudo:session): session closed for user root
Nov 13 17:19:25 user nova-compute[75100]: INFO oslo.privsep.daemon [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Spawned new privsep daemon via rootwrap
Nov 13 17:19:25 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 17:19:25 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 17:19:25 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 13 17:19:25 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84366
Nov 13 17:19:25 user nova-compute[75100]: WARNING oslo_privsep.priv_context [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] privsep daemon already running
Nov 13 17:19:25 user nova-compute[75100]: DEBUG nova.policy [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33657093c7ab4112994a1b7e997cfb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c1d1cfd844465e85239be73eb73cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:19:25 user nova-compute[75100]: WARNING oslo_privsep.priv_context [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] privsep daemon already running
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Successfully created port: b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:19:25 user nova-compute[75100]: INFO nova.compute.claims [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Claim successful on node user
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Successfully created port: 66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk 1073741824" returned: 0 in 0.041s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.225s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.157s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk 1073741824" returned: 0 in 0.061s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.469s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Cannot resize image /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Ensure instance console log exists: /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk 1073741824" returned: 0 in 0.050s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Cannot resize image /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Ensure instance console log exists: /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:19:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Creating image(s)
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "/opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "/opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.policy [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77f5fd132c0e46438884eaffae0beab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf7bde4b774e3dac46d41d32496efa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Cannot resize image /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Ensure instance console log exists: /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk 1073741824" returned: 0 in 0.076s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Successfully created port: daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.211s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:19:27 user nova-compute[75100]: INFO nova.compute.claims [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Claim successful on node user
Nov 13 17:19:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Cannot resize image /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Ensure instance console log exists: /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:19:27 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:19:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Successfully updated port: b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "refresh_cache-31779592-a9f2-4aae-a658-e055ec832b37" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquired lock "refresh_cache-31779592-a9f2-4aae-a658-e055ec832b37" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:19:28 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Creating image(s)
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "/opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "/opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.policy [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ea28cc48696459f96e7ad8dacad33da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119dde6420324f52a165a5610c77d1c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-ea0a5ef3-3d56-4e9e-8550-79d514e70467 req-297cbe9d-e524-4dce-898f-f91af3145c98 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Received event network-changed-b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-ea0a5ef3-3d56-4e9e-8550-79d514e70467 req-297cbe9d-e524-4dce-898f-f91af3145c98 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Refreshing instance network info cache due to event network-changed-b88af3f7-eb48-47b2-84c0-b991584a6826. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ea0a5ef3-3d56-4e9e-8550-79d514e70467 req-297cbe9d-e524-4dce-898f-f91af3145c98 service nova] Acquiring lock "refresh_cache-31779592-a9f2-4aae-a658-e055ec832b37" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk 1073741824" returned: 0 in 0.042s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Successfully updated port: 66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquired lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-3d92543b-00dd-4e89-bf1f-d9bcc98ee221 req-e4c538f6-af7b-49e3-8cf8-250ed6871231 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-changed-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-3d92543b-00dd-4e89-bf1f-d9bcc98ee221 req-e4c538f6-af7b-49e3-8cf8-250ed6871231 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Refreshing instance network info cache due to event network-changed-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3d92543b-00dd-4e89-bf1f-d9bcc98ee221 req-e4c538f6-af7b-49e3-8cf8-250ed6871231 service nova] Acquiring lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Cannot resize image /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Ensure instance console log exists: /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Successfully created port: d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:19:29 user nova-compute[75100]: INFO nova.compute.claims [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Claim successful on node user
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Updating instance_info_cache with network_info: [{"id": "b88af3f7-eb48-47b2-84c0-b991584a6826", "address": "fa:16:3e:9d:22:c1", "network": {"id": "7593ddf6-1ad8-4498-9cbd-3ad9b77db488", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1497148107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e9dffd99824724a921a72499143852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88af3f7-eb", "ovs_interfaceid": "b88af3f7-eb48-47b2-84c0-b991584a6826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Releasing lock "refresh_cache-31779592-a9f2-4aae-a658-e055ec832b37" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Instance network_info: |[{"id": "b88af3f7-eb48-47b2-84c0-b991584a6826", "address": "fa:16:3e:9d:22:c1", "network": {"id": "7593ddf6-1ad8-4498-9cbd-3ad9b77db488", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1497148107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e9dffd99824724a921a72499143852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88af3f7-eb", "ovs_interfaceid": "b88af3f7-eb48-47b2-84c0-b991584a6826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ea0a5ef3-3d56-4e9e-8550-79d514e70467 req-297cbe9d-e524-4dce-898f-f91af3145c98 service nova] Acquired lock "refresh_cache-31779592-a9f2-4aae-a658-e055ec832b37" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-ea0a5ef3-3d56-4e9e-8550-79d514e70467 req-297cbe9d-e524-4dce-898f-f91af3145c98 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Refreshing network info cache for port b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Start _get_guest_xml network_info=[{"id": "b88af3f7-eb48-47b2-84c0-b991584a6826", "address": "fa:16:3e:9d:22:c1", "network": {"id": "7593ddf6-1ad8-4498-9cbd-3ad9b77db488", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1497148107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e9dffd99824724a921a72499143852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88af3f7-eb", "ovs_interfaceid": "b88af3f7-eb48-47b2-84c0-b991584a6826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:19:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1551466350',display_name='tempest-DeleteServersTestJSON-server-1551466350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1551466350',id=1,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46e9dffd99824724a921a72499143852',ramdisk_id='',reservation_id='r-sfs013iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-567642559',owner_user_name='tempest-DeleteServersTestJSON-567642559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:22Z,user_data=None,user_id='cb423a49f7954aa29f976f2f5d0e27ec',uuid=31779592-a9f2-4aae-a658-e055ec832b37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b88af3f7-eb48-47b2-84c0-b991584a6826", "address": "fa:16:3e:9d:22:c1", "network": {"id": "7593ddf6-1ad8-4498-9cbd-3ad9b77db488", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1497148107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e9dffd99824724a921a72499143852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88af3f7-eb", "ovs_interfaceid": "b88af3f7-eb48-47b2-84c0-b991584a6826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Converting VIF {"id": "b88af3f7-eb48-47b2-84c0-b991584a6826", "address": "fa:16:3e:9d:22:c1", "network": {"id": "7593ddf6-1ad8-4498-9cbd-3ad9b77db488", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1497148107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e9dffd99824724a921a72499143852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88af3f7-eb", "ovs_interfaceid": "b88af3f7-eb48-47b2-84c0-b991584a6826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:22:c1,bridge_name='br-int',has_traffic_filtering=True,id=b88af3f7-eb48-47b2-84c0-b991584a6826,network=Network(7593ddf6-1ad8-4498-9cbd-3ad9b77db488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88af3f7-eb') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.objects.instance [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lazy-loading 'pci_devices' on Instance uuid 31779592-a9f2-4aae-a658-e055ec832b37 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:19:29 user nova-compute[75100]:   <uuid>31779592-a9f2-4aae-a658-e055ec832b37</uuid>
Nov 13 17:19:29 user nova-compute[75100]:   <name>instance-00000001</name>
Nov 13 17:19:29 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:19:29 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:19:29 user nova-compute[75100]:   <metadata>
Nov 13 17:19:29 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:19:29 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:19:29 user nova-compute[75100]:       <nova:name>tempest-DeleteServersTestJSON-server-1551466350</nova:name>
Nov 13 17:19:29 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:19:29</nova:creationTime>
Nov 13 17:19:29 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:19:29 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:19:29 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:19:29 user nova-compute[75100]:       <nova:owner>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:user uuid="cb423a49f7954aa29f976f2f5d0e27ec">tempest-DeleteServersTestJSON-567642559-project-member</nova:user>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:project uuid="46e9dffd99824724a921a72499143852">tempest-DeleteServersTestJSON-567642559</nova:project>
Nov 13 17:19:29 user nova-compute[75100]:       </nova:owner>
Nov 13 17:19:29 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:19:29 user nova-compute[75100]:       <nova:ports>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:port uuid="b88af3f7-eb48-47b2-84c0-b991584a6826">
Nov 13 17:19:29 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:19:29 user nova-compute[75100]:         </nova:port>
Nov 13 17:19:29 user nova-compute[75100]:       </nova:ports>
Nov 13 17:19:29 user nova-compute[75100]:     </nova:instance>
Nov 13 17:19:29 user nova-compute[75100]:   </metadata>
Nov 13 17:19:29 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:19:29 user nova-compute[75100]:     <system>
Nov 13 17:19:29 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:19:29 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:19:29 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:19:29 user nova-compute[75100]:       <entry name="serial">31779592-a9f2-4aae-a658-e055ec832b37</entry>
Nov 13 17:19:29 user nova-compute[75100]:       <entry name="uuid">31779592-a9f2-4aae-a658-e055ec832b37</entry>
Nov 13 17:19:29 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:19:29 user nova-compute[75100]:     </system>
Nov 13 17:19:29 user nova-compute[75100]:   </sysinfo>
Nov 13 17:19:29 user nova-compute[75100]:   <os>
Nov 13 17:19:29 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:19:29 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:19:29 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:19:29 user nova-compute[75100]:   </os>
Nov 13 17:19:29 user nova-compute[75100]:   <features>
Nov 13 17:19:29 user nova-compute[75100]:     <acpi/>
Nov 13 17:19:29 user nova-compute[75100]:     <apic/>
Nov 13 17:19:29 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:19:29 user nova-compute[75100]:   </features>
Nov 13 17:19:29 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:19:29 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:19:29 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:19:29 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:19:29 user nova-compute[75100]:   </clock>
Nov 13 17:19:29 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:19:29 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:19:29 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:19:29 user nova-compute[75100]:   </cpu>
Nov 13 17:19:29 user nova-compute[75100]:   <devices>
Nov 13 17:19:29 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:19:29 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:19:29 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk"/>
Nov 13 17:19:29 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:19:29 user nova-compute[75100]:     </disk>
Nov 13 17:19:29 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:19:29 user nova-compute[75100]:       <mac address="fa:16:3e:9d:22:c1"/>
Nov 13 17:19:29 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:29 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:19:29 user nova-compute[75100]:       <target dev="tapb88af3f7-eb"/>
Nov 13 17:19:29 user nova-compute[75100]:     </interface>
Nov 13 17:19:29 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:19:29 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/console.log" append="off"/>
Nov 13 17:19:29 user nova-compute[75100]:     </serial>
Nov 13 17:19:29 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:19:29 user nova-compute[75100]:     <video>
Nov 13 17:19:29 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:29 user nova-compute[75100]:     </video>
Nov 13 17:19:29 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:19:29 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:19:29 user nova-compute[75100]:     </rng>
Nov 13 17:19:29 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:19:29 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:19:29 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:19:29 user nova-compute[75100]:     </memballoon>
Nov 13 17:19:29 user nova-compute[75100]:   </devices>
Nov 13 17:19:29 user nova-compute[75100]: </domain>
Nov 13 17:19:29 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1551466350',display_name='tempest-DeleteServersTestJSON-server-1551466350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1551466350',id=1,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46e9dffd99824724a921a72499143852',ramdisk_id='',reservation_id='r-sfs013iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-567642559',owner_user_name='tempest-DeleteServersTestJSON-567642559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:22Z,user_data=None,user_id='cb423a49f7954aa29f976f2f5d0e27ec',uuid=31779592-a9f2-4aae-a658-e055ec832b37,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b88af3f7-eb48-47b2-84c0-b991584a6826", "address": "fa:16:3e:9d:22:c1", "network": {"id": "7593ddf6-1ad8-4498-9cbd-3ad9b77db488", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1497148107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e9dffd99824724a921a72499143852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88af3f7-eb", "ovs_interfaceid": "b88af3f7-eb48-47b2-84c0-b991584a6826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Converting VIF {"id": "b88af3f7-eb48-47b2-84c0-b991584a6826", "address": "fa:16:3e:9d:22:c1", "network": {"id": "7593ddf6-1ad8-4498-9cbd-3ad9b77db488", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1497148107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e9dffd99824724a921a72499143852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88af3f7-eb", "ovs_interfaceid": "b88af3f7-eb48-47b2-84c0-b991584a6826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:22:c1,bridge_name='br-int',has_traffic_filtering=True,id=b88af3f7-eb48-47b2-84c0-b991584a6826,network=Network(7593ddf6-1ad8-4498-9cbd-3ad9b77db488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88af3f7-eb') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG os_vif [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:22:c1,bridge_name='br-int',has_traffic_filtering=True,id=b88af3f7-eb48-47b2-84c0-b991584a6826,network=Network(7593ddf6-1ad8-4498-9cbd-3ad9b77db488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88af3f7-eb') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Successfully updated port: daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Created schema index Interface.name {{(pid=75100) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Created schema index Port.name {{(pid=75100) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Created schema index Bridge.name {{(pid=75100) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [POLLOUT] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquired lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Updating instance_info_cache with network_info: [{"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Releasing lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Instance network_info: |[{"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3d92543b-00dd-4e89-bf1f-d9bcc98ee221 req-e4c538f6-af7b-49e3-8cf8-250ed6871231 service nova] Acquired lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-3d92543b-00dd-4e89-bf1f-d9bcc98ee221 req-e4c538f6-af7b-49e3-8cf8-250ed6871231 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Refreshing network info cache for port 66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Start _get_guest_xml network_info=[{"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2c725c0-fafd-55f8-9b71-b35b76e97e84', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:29 user nova-compute[75100]: INFO oslo.privsep.daemon [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpd6iytotd/privsep.sock']
Nov 13 17:19:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:19:29 user sudo[84446]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpd6iytotd/privsep.sock
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:19:29 user sudo[84446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1748995308',display_name='tempest-ServerRescueNegativeTestJSON-server-1748995308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1748995308',id=2,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6c1d1cfd844465e85239be73eb73cec',ramdisk_id='',reservation_id='r-xo00uc1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1273984533',owner_user_name='tempest-ServerRescueNegativeTestJSON-1273984533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:23Z,user_data=None,user_id='33657093c7ab4112994a1b7e997cfb34',uuid=15b3e2ef-4e0b-4ace-bd74-c34d445b60e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converting VIF {"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:c9:ce,bridge_name='br-int',has_traffic_filtering=True,id=66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66fc9bb6-ce') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'pci_devices' on Instance uuid 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:19:29 user nova-compute[75100]:   <uuid>15b3e2ef-4e0b-4ace-bd74-c34d445b60e1</uuid>
Nov 13 17:19:29 user nova-compute[75100]:   <name>instance-00000002</name>
Nov 13 17:19:29 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:19:29 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:19:29 user nova-compute[75100]:   <metadata>
Nov 13 17:19:29 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:19:29 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:19:29 user nova-compute[75100]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1748995308</nova:name>
Nov 13 17:19:29 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:19:29</nova:creationTime>
Nov 13 17:19:29 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:19:29 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:19:29 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:19:29 user nova-compute[75100]:       <nova:owner>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:user uuid="33657093c7ab4112994a1b7e997cfb34">tempest-ServerRescueNegativeTestJSON-1273984533-project-member</nova:user>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:project uuid="d6c1d1cfd844465e85239be73eb73cec">tempest-ServerRescueNegativeTestJSON-1273984533</nova:project>
Nov 13 17:19:29 user nova-compute[75100]:       </nova:owner>
Nov 13 17:19:29 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:19:29 user nova-compute[75100]:       <nova:ports>
Nov 13 17:19:29 user nova-compute[75100]:         <nova:port uuid="66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36">
Nov 13 17:19:29 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 17:19:29 user nova-compute[75100]:         </nova:port>
Nov 13 17:19:29 user nova-compute[75100]:       </nova:ports>
Nov 13 17:19:29 user nova-compute[75100]:     </nova:instance>
Nov 13 17:19:29 user nova-compute[75100]:   </metadata>
Nov 13 17:19:29 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:19:29 user nova-compute[75100]:     <system>
Nov 13 17:19:29 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:19:29 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:19:29 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:19:29 user nova-compute[75100]:       <entry name="serial">15b3e2ef-4e0b-4ace-bd74-c34d445b60e1</entry>
Nov 13 17:19:29 user nova-compute[75100]:       <entry name="uuid">15b3e2ef-4e0b-4ace-bd74-c34d445b60e1</entry>
Nov 13 17:19:29 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:19:29 user nova-compute[75100]:     </system>
Nov 13 17:19:29 user nova-compute[75100]:   </sysinfo>
Nov 13 17:19:29 user nova-compute[75100]:   <os>
Nov 13 17:19:29 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:19:29 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:19:29 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:19:29 user nova-compute[75100]:   </os>
Nov 13 17:19:29 user nova-compute[75100]:   <features>
Nov 13 17:19:29 user nova-compute[75100]:     <acpi/>
Nov 13 17:19:29 user nova-compute[75100]:     <apic/>
Nov 13 17:19:29 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:19:29 user nova-compute[75100]:   </features>
Nov 13 17:19:29 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:19:29 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:19:29 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:19:29 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:19:29 user nova-compute[75100]:   </clock>
Nov 13 17:19:29 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:19:29 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:19:29 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:19:29 user nova-compute[75100]:   </cpu>
Nov 13 17:19:29 user nova-compute[75100]:   <devices>
Nov 13 17:19:29 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:19:29 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:19:29 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk"/>
Nov 13 17:19:29 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:19:29 user nova-compute[75100]:     </disk>
Nov 13 17:19:29 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:19:29 user nova-compute[75100]:       <mac address="fa:16:3e:41:c9:ce"/>
Nov 13 17:19:29 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:29 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:19:29 user nova-compute[75100]:       <target dev="tap66fc9bb6-ce"/>
Nov 13 17:19:29 user nova-compute[75100]:     </interface>
Nov 13 17:19:29 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:19:29 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/console.log" append="off"/>
Nov 13 17:19:29 user nova-compute[75100]:     </serial>
Nov 13 17:19:29 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:19:29 user nova-compute[75100]:     <video>
Nov 13 17:19:29 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:29 user nova-compute[75100]:     </video>
Nov 13 17:19:29 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:19:29 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:19:29 user nova-compute[75100]:     </rng>
Nov 13 17:19:29 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:19:29 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:19:29 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:19:29 user nova-compute[75100]:     </memballoon>
Nov 13 17:19:29 user nova-compute[75100]:   </devices>
Nov 13 17:19:29 user nova-compute[75100]: </domain>
Nov 13 17:19:29 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1748995308',display_name='tempest-ServerRescueNegativeTestJSON-server-1748995308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1748995308',id=2,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6c1d1cfd844465e85239be73eb73cec',ramdisk_id='',reservation_id='r-xo00uc1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1273984533',owner_user_name='tempest-ServerRescueNegativeTestJSON-1273984533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:23Z,user_data=None,user_id='33657093c7ab4112994a1b7e997cfb34',uuid=15b3e2ef-4e0b-4ace-bd74-c34d445b60e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converting VIF {"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:c9:ce,bridge_name='br-int',has_traffic_filtering=True,id=66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66fc9bb6-ce') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG os_vif [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c9:ce,bridge_name='br-int',has_traffic_filtering=True,id=66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66fc9bb6-ce') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0fcb8f0-c4c0-5de4-8e1a-33dd6d5758cc', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:19:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Creating image(s)
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "/opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "/opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "/opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:19:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.policy [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '047fae6bc2134ea2a43fb06dbeabbb0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa1230bfae049af9ce657d6889eddad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.218s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk 1073741824" returned: 0 in 0.050s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Successfully created port: 15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Updating instance_info_cache with network_info: [{"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-9a26f572-f673-4ca4-ac22-0f75fe840d03 req-9bdb40ff-02c0-40a3-96d1-bb532316a054 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received event network-changed-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-9a26f572-f673-4ca4-ac22-0f75fe840d03 req-9bdb40ff-02c0-40a3-96d1-bb532316a054 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Refreshing instance network info cache due to event network-changed-daca5488-cacc-44a2-9798-4da784566bad. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a26f572-f673-4ca4-ac22-0f75fe840d03 req-9bdb40ff-02c0-40a3-96d1-bb532316a054 service nova] Acquiring lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Releasing lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Instance network_info: |[{"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a26f572-f673-4ca4-ac22-0f75fe840d03 req-9bdb40ff-02c0-40a3-96d1-bb532316a054 service nova] Acquired lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.network.neutron [req-9a26f572-f673-4ca4-ac22-0f75fe840d03 req-9bdb40ff-02c0-40a3-96d1-bb532316a054 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Refreshing network info cache for port daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Start _get_guest_xml network_info=[{"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:19:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1848893497',display_name='tempest-ServerRescueNegativeTestJSON-server-1848893497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1848893497',id=3,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6c1d1cfd844465e85239be73eb73cec',ramdisk_id='',reservation_id='r-xeiyvn89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1273984533',owner_user_name='tempest-ServerRescueNegativeTestJSON-1273984533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:25Z,user_data=None,user_id='33657093c7ab4112994a1b7e997cfb34',uuid=7f3f3c5b-5128-4356-a995-fe3265f49fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converting VIF {"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=daca5488-cacc-44a2-9798-4da784566bad,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaca5488-ca') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.objects.instance [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f3f3c5b-5128-4356-a995-fe3265f49fe1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:19:30 user nova-compute[75100]:   <uuid>7f3f3c5b-5128-4356-a995-fe3265f49fe1</uuid>
Nov 13 17:19:30 user nova-compute[75100]:   <name>instance-00000003</name>
Nov 13 17:19:30 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:19:30 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:19:30 user nova-compute[75100]:   <metadata>
Nov 13 17:19:30 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:19:30 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:19:30 user nova-compute[75100]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1848893497</nova:name>
Nov 13 17:19:30 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:19:30</nova:creationTime>
Nov 13 17:19:30 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:19:30 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:19:30 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:19:30 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:19:30 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:19:30 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:19:30 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:19:30 user nova-compute[75100]:       <nova:owner>
Nov 13 17:19:30 user nova-compute[75100]:         <nova:user uuid="33657093c7ab4112994a1b7e997cfb34">tempest-ServerRescueNegativeTestJSON-1273984533-project-member</nova:user>
Nov 13 17:19:30 user nova-compute[75100]:         <nova:project uuid="d6c1d1cfd844465e85239be73eb73cec">tempest-ServerRescueNegativeTestJSON-1273984533</nova:project>
Nov 13 17:19:30 user nova-compute[75100]:       </nova:owner>
Nov 13 17:19:30 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:19:30 user nova-compute[75100]:       <nova:ports>
Nov 13 17:19:30 user nova-compute[75100]:         <nova:port uuid="daca5488-cacc-44a2-9798-4da784566bad">
Nov 13 17:19:30 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:19:30 user nova-compute[75100]:         </nova:port>
Nov 13 17:19:30 user nova-compute[75100]:       </nova:ports>
Nov 13 17:19:30 user nova-compute[75100]:     </nova:instance>
Nov 13 17:19:30 user nova-compute[75100]:   </metadata>
Nov 13 17:19:30 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:19:30 user nova-compute[75100]:     <system>
Nov 13 17:19:30 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:19:30 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:19:30 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:19:30 user nova-compute[75100]:       <entry name="serial">7f3f3c5b-5128-4356-a995-fe3265f49fe1</entry>
Nov 13 17:19:30 user nova-compute[75100]:       <entry name="uuid">7f3f3c5b-5128-4356-a995-fe3265f49fe1</entry>
Nov 13 17:19:30 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:19:30 user nova-compute[75100]:     </system>
Nov 13 17:19:30 user nova-compute[75100]:   </sysinfo>
Nov 13 17:19:30 user nova-compute[75100]:   <os>
Nov 13 17:19:30 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:19:30 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:19:30 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:19:30 user nova-compute[75100]:   </os>
Nov 13 17:19:30 user nova-compute[75100]:   <features>
Nov 13 17:19:30 user nova-compute[75100]:     <acpi/>
Nov 13 17:19:30 user nova-compute[75100]:     <apic/>
Nov 13 17:19:30 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:19:30 user nova-compute[75100]:   </features>
Nov 13 17:19:30 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:19:30 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:19:30 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:19:30 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:19:30 user nova-compute[75100]:   </clock>
Nov 13 17:19:30 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:19:30 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:19:30 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:19:30 user nova-compute[75100]:   </cpu>
Nov 13 17:19:30 user nova-compute[75100]:   <devices>
Nov 13 17:19:30 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:19:30 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:19:30 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk"/>
Nov 13 17:19:30 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:19:30 user nova-compute[75100]:     </disk>
Nov 13 17:19:30 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:19:30 user nova-compute[75100]:       <mac address="fa:16:3e:85:dc:26"/>
Nov 13 17:19:30 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:30 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:19:30 user nova-compute[75100]:       <target dev="tapdaca5488-ca"/>
Nov 13 17:19:30 user nova-compute[75100]:     </interface>
Nov 13 17:19:30 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:19:30 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/console.log" append="off"/>
Nov 13 17:19:30 user nova-compute[75100]:     </serial>
Nov 13 17:19:30 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:19:30 user nova-compute[75100]:     <video>
Nov 13 17:19:30 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:30 user nova-compute[75100]:     </video>
Nov 13 17:19:30 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:19:30 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:19:30 user nova-compute[75100]:     </rng>
Nov 13 17:19:30 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:19:30 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:19:30 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:19:30 user nova-compute[75100]:     </memballoon>
Nov 13 17:19:30 user nova-compute[75100]:   </devices>
Nov 13 17:19:30 user nova-compute[75100]: </domain>
Nov 13 17:19:30 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1848893497',display_name='tempest-ServerRescueNegativeTestJSON-server-1848893497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1848893497',id=3,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6c1d1cfd844465e85239be73eb73cec',ramdisk_id='',reservation_id='r-xeiyvn89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1273984533',owner_user_name='tempest-ServerRescueNegativeTestJSON-1273984533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:25Z,user_data=None,user_id='33657093c7ab4112994a1b7e997cfb34',uuid=7f3f3c5b-5128-4356-a995-fe3265f49fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converting VIF {"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=daca5488-cacc-44a2-9798-4da784566bad,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaca5488-ca') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG os_vif [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=daca5488-cacc-44a2-9798-4da784566bad,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaca5488-ca') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd600af56-41d9-5178-8332-96fc3c3ef5aa', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Cannot resize image /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Ensure instance console log exists: /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-ea0a5ef3-3d56-4e9e-8550-79d514e70467 req-297cbe9d-e524-4dce-898f-f91af3145c98 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Updated VIF entry in instance network info cache for port b88af3f7-eb48-47b2-84c0-b991584a6826. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-ea0a5ef3-3d56-4e9e-8550-79d514e70467 req-297cbe9d-e524-4dce-898f-f91af3145c98 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Updating instance_info_cache with network_info: [{"id": "b88af3f7-eb48-47b2-84c0-b991584a6826", "address": "fa:16:3e:9d:22:c1", "network": {"id": "7593ddf6-1ad8-4498-9cbd-3ad9b77db488", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1497148107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e9dffd99824724a921a72499143852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88af3f7-eb", "ovs_interfaceid": "b88af3f7-eb48-47b2-84c0-b991584a6826", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ea0a5ef3-3d56-4e9e-8550-79d514e70467 req-297cbe9d-e524-4dce-898f-f91af3145c98 service nova] Releasing lock "refresh_cache-31779592-a9f2-4aae-a658-e055ec832b37" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Successfully updated port: d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquired lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:19:31 user sudo[84446]: pam_unix(sudo:session): session closed for user root
Nov 13 17:19:31 user nova-compute[75100]: INFO oslo.privsep.daemon [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Spawned new privsep daemon via rootwrap
Nov 13 17:19:31 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 17:19:31 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 17:19:31 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 13 17:19:31 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84464
Nov 13 17:19:31 user nova-compute[75100]: WARNING oslo_privsep.priv_context [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] privsep daemon already running
Nov 13 17:19:31 user nova-compute[75100]: WARNING oslo_privsep.priv_context [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] privsep daemon already running
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-3d92543b-00dd-4e89-bf1f-d9bcc98ee221 req-e4c538f6-af7b-49e3-8cf8-250ed6871231 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Updated VIF entry in instance network info cache for port 66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-3d92543b-00dd-4e89-bf1f-d9bcc98ee221 req-e4c538f6-af7b-49e3-8cf8-250ed6871231 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Updating instance_info_cache with network_info: [{"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3d92543b-00dd-4e89-bf1f-d9bcc98ee221 req-e4c538f6-af7b-49e3-8cf8-250ed6871231 service nova] Releasing lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-9a26f572-f673-4ca4-ac22-0f75fe840d03 req-9bdb40ff-02c0-40a3-96d1-bb532316a054 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Updated VIF entry in instance network info cache for port daca5488-cacc-44a2-9798-4da784566bad. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-9a26f572-f673-4ca4-ac22-0f75fe840d03 req-9bdb40ff-02c0-40a3-96d1-bb532316a054 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Updating instance_info_cache with network_info: [{"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a26f572-f673-4ca4-ac22-0f75fe840d03 req-9bdb40ff-02c0-40a3-96d1-bb532316a054 service nova] Releasing lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-f803bd70-850e-4971-b00b-c50f133bbeeb req-86b07ce6-1e0c-45a8-b1f5-27c1c9ef8231 service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Received event network-changed-d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-f803bd70-850e-4971-b00b-c50f133bbeeb req-86b07ce6-1e0c-45a8-b1f5-27c1c9ef8231 service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Refreshing instance network info cache due to event network-changed-d655d771-6c6c-49e9-89da-810f79e78314. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f803bd70-850e-4971-b00b-c50f133bbeeb req-86b07ce6-1e0c-45a8-b1f5-27c1c9ef8231 service nova] Acquiring lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb88af3f7-eb, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb88af3f7-eb, col_values=(('qos', UUID('05f853ed-76a8-461c-a101-3491c64cd43c')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb88af3f7-eb, col_values=(('external_ids', {'iface-id': 'b88af3f7-eb48-47b2-84c0-b991584a6826', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:22:c1', 'vm-uuid': '31779592-a9f2-4aae-a658-e055ec832b37'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:31 user nova-compute[75100]: INFO os_vif [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:22:c1,bridge_name='br-int',has_traffic_filtering=True,id=b88af3f7-eb48-47b2-84c0-b991584a6826,network=Network(7593ddf6-1ad8-4498-9cbd-3ad9b77db488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88af3f7-eb')
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaca5488-ca, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaca5488-ca, col_values=(('qos', UUID('353e39ed-85bf-4eb3-8923-4c0b81072ae6')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaca5488-ca, col_values=(('external_ids', {'iface-id': 'daca5488-cacc-44a2-9798-4da784566bad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:dc:26', 'vm-uuid': '7f3f3c5b-5128-4356-a995-fe3265f49fe1'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:31 user nova-compute[75100]: INFO os_vif [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=daca5488-cacc-44a2-9798-4da784566bad,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaca5488-ca')
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66fc9bb6-ce, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66fc9bb6-ce, col_values=(('qos', UUID('181a0497-a627-40ee-9930-1e2935c0fb5b')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66fc9bb6-ce, col_values=(('external_ids', {'iface-id': '66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:c9:ce', 'vm-uuid': '15b3e2ef-4e0b-4ace-bd74-c34d445b60e1'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:31 user nova-compute[75100]: INFO os_vif [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:c9:ce,bridge_name='br-int',has_traffic_filtering=True,id=66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66fc9bb6-ce')
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] No VIF found with MAC fa:16:3e:9d:22:c1, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No VIF found with MAC fa:16:3e:85:dc:26, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:19:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No VIF found with MAC fa:16:3e:41:c9:ce, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Successfully updated port: 15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquired lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Updating instance_info_cache with network_info: [{"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-43eb1f06-8c1f-4711-bbe8-174749d67260 req-efac0328-0a99-4c35-90cd-900835dba03a service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Received event network-changed-15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-43eb1f06-8c1f-4711-bbe8-174749d67260 req-efac0328-0a99-4c35-90cd-900835dba03a service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Refreshing instance network info cache due to event network-changed-15335f7b-d811-486f-a5ce-3643fa79fbc7. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-43eb1f06-8c1f-4711-bbe8-174749d67260 req-efac0328-0a99-4c35-90cd-900835dba03a service nova] Acquiring lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Releasing lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Instance network_info: |[{"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f803bd70-850e-4971-b00b-c50f133bbeeb req-86b07ce6-1e0c-45a8-b1f5-27c1c9ef8231 service nova] Acquired lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-f803bd70-850e-4971-b00b-c50f133bbeeb req-86b07ce6-1e0c-45a8-b1f5-27c1c9ef8231 service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Refreshing network info cache for port d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Start _get_guest_xml network_info=[{"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:19:32 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:32 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2025403910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2025403910',id=4,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-rfalet2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:26Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=ad5356a6-48bb-4aa5-8ccb-06ef577b9b44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:08:c3,bridge_name='br-int',has_traffic_filtering=True,id=d655d771-6c6c-49e9-89da-810f79e78314,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd655d771-6c') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'pci_devices' on Instance uuid ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:19:32 user nova-compute[75100]:   <uuid>ad5356a6-48bb-4aa5-8ccb-06ef577b9b44</uuid>
Nov 13 17:19:32 user nova-compute[75100]:   <name>instance-00000004</name>
Nov 13 17:19:32 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:19:32 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:19:32 user nova-compute[75100]:   <metadata>
Nov 13 17:19:32 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:19:32 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:19:32 user nova-compute[75100]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2025403910</nova:name>
Nov 13 17:19:32 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:19:32</nova:creationTime>
Nov 13 17:19:32 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:19:32 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:19:32 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:19:32 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:19:32 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:19:32 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:19:32 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:19:32 user nova-compute[75100]:       <nova:owner>
Nov 13 17:19:32 user nova-compute[75100]:         <nova:user uuid="77f5fd132c0e46438884eaffae0beab9">tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member</nova:user>
Nov 13 17:19:32 user nova-compute[75100]:         <nova:project uuid="f1bf7bde4b774e3dac46d41d32496efa">tempest-ServerBootFromVolumeStableRescueTest-1217233624</nova:project>
Nov 13 17:19:32 user nova-compute[75100]:       </nova:owner>
Nov 13 17:19:32 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:19:32 user nova-compute[75100]:       <nova:ports>
Nov 13 17:19:32 user nova-compute[75100]:         <nova:port uuid="d655d771-6c6c-49e9-89da-810f79e78314">
Nov 13 17:19:32 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 17:19:32 user nova-compute[75100]:         </nova:port>
Nov 13 17:19:32 user nova-compute[75100]:       </nova:ports>
Nov 13 17:19:32 user nova-compute[75100]:     </nova:instance>
Nov 13 17:19:32 user nova-compute[75100]:   </metadata>
Nov 13 17:19:32 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:19:32 user nova-compute[75100]:     <system>
Nov 13 17:19:32 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:19:32 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:19:32 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:19:32 user nova-compute[75100]:       <entry name="serial">ad5356a6-48bb-4aa5-8ccb-06ef577b9b44</entry>
Nov 13 17:19:32 user nova-compute[75100]:       <entry name="uuid">ad5356a6-48bb-4aa5-8ccb-06ef577b9b44</entry>
Nov 13 17:19:32 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:19:32 user nova-compute[75100]:     </system>
Nov 13 17:19:32 user nova-compute[75100]:   </sysinfo>
Nov 13 17:19:32 user nova-compute[75100]:   <os>
Nov 13 17:19:32 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:19:32 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:19:32 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:19:32 user nova-compute[75100]:   </os>
Nov 13 17:19:32 user nova-compute[75100]:   <features>
Nov 13 17:19:32 user nova-compute[75100]:     <acpi/>
Nov 13 17:19:32 user nova-compute[75100]:     <apic/>
Nov 13 17:19:32 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:19:32 user nova-compute[75100]:   </features>
Nov 13 17:19:32 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:19:32 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:19:32 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:19:32 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:19:32 user nova-compute[75100]:   </clock>
Nov 13 17:19:32 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:19:32 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:19:32 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:19:32 user nova-compute[75100]:   </cpu>
Nov 13 17:19:32 user nova-compute[75100]:   <devices>
Nov 13 17:19:32 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:19:32 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:19:32 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk"/>
Nov 13 17:19:32 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:19:32 user nova-compute[75100]:     </disk>
Nov 13 17:19:32 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:19:32 user nova-compute[75100]:       <mac address="fa:16:3e:33:08:c3"/>
Nov 13 17:19:32 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:32 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:19:32 user nova-compute[75100]:       <target dev="tapd655d771-6c"/>
Nov 13 17:19:32 user nova-compute[75100]:     </interface>
Nov 13 17:19:32 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:19:32 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/console.log" append="off"/>
Nov 13 17:19:32 user nova-compute[75100]:     </serial>
Nov 13 17:19:32 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:19:32 user nova-compute[75100]:     <video>
Nov 13 17:19:32 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:32 user nova-compute[75100]:     </video>
Nov 13 17:19:32 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:19:32 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:19:32 user nova-compute[75100]:     </rng>
Nov 13 17:19:32 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:19:32 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:19:32 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:19:32 user nova-compute[75100]:     </memballoon>
Nov 13 17:19:32 user nova-compute[75100]:   </devices>
Nov 13 17:19:32 user nova-compute[75100]: </domain>
Nov 13 17:19:32 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2025403910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2025403910',id=4,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-rfalet2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:26Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=ad5356a6-48bb-4aa5-8ccb-06ef577b9b44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:08:c3,bridge_name='br-int',has_traffic_filtering=True,id=d655d771-6c6c-49e9-89da-810f79e78314,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd655d771-6c') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG os_vif [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:08:c3,bridge_name='br-int',has_traffic_filtering=True,id=d655d771-6c6c-49e9-89da-810f79e78314,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd655d771-6c') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47f2a469-fd72-509b-8623-7fcd6efd6fb2', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd655d771-6c, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd655d771-6c, col_values=(('qos', UUID('0b1d5fc9-f6ad-40a5-a4af-abb953e0cdb2')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd655d771-6c, col_values=(('external_ids', {'iface-id': 'd655d771-6c6c-49e9-89da-810f79e78314', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:08:c3', 'vm-uuid': 'ad5356a6-48bb-4aa5-8ccb-06ef577b9b44'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:32 user nova-compute[75100]: INFO os_vif [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:08:c3,bridge_name='br-int',has_traffic_filtering=True,id=d655d771-6c6c-49e9-89da-810f79e78314,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd655d771-6c')
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Successfully created port: 4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No VIF found with MAC fa:16:3e:33:08:c3, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:19:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-f803bd70-850e-4971-b00b-c50f133bbeeb req-86b07ce6-1e0c-45a8-b1f5-27c1c9ef8231 service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Updated VIF entry in instance network info cache for port d655d771-6c6c-49e9-89da-810f79e78314. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-f803bd70-850e-4971-b00b-c50f133bbeeb req-86b07ce6-1e0c-45a8-b1f5-27c1c9ef8231 service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Updating instance_info_cache with network_info: [{"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f803bd70-850e-4971-b00b-c50f133bbeeb req-86b07ce6-1e0c-45a8-b1f5-27c1c9ef8231 service nova] Releasing lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updating instance_info_cache with network_info: [{"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Releasing lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Instance network_info: |[{"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-43eb1f06-8c1f-4711-bbe8-174749d67260 req-efac0328-0a99-4c35-90cd-900835dba03a service nova] Acquired lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-43eb1f06-8c1f-4711-bbe8-174749d67260 req-efac0328-0a99-4c35-90cd-900835dba03a service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Refreshing network info cache for port 15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Start _get_guest_xml network_info=[{"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:19:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1834635745',display_name='tempest-ServerActionsTestOtherA-server-1834635745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1834635745',id=5,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArXX8H/F/4k/bCD26MQyJfYc6kVyijAa21ATX3s9SJ4y/SgOLDqvjWXABytQ7Y0rezN8922Yqg0PmzPzy90j9+erJSCwuQJnigd+guQkVWmuyFrLUQ16eK1oB+ijXr+Rw==',key_name='tempest-keypair-216019137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-i2xj0rnj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=b0c1af59-f1bd-4c02-8843-e477cd7169d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8a:63,bridge_name='br-int',has_traffic_filtering=True,id=15335f7b-d811-486f-a5ce-3643fa79fbc7,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15335f7b-d8') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.objects.instance [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lazy-loading 'pci_devices' on Instance uuid b0c1af59-f1bd-4c02-8843-e477cd7169d8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:19:33 user nova-compute[75100]:   <uuid>b0c1af59-f1bd-4c02-8843-e477cd7169d8</uuid>
Nov 13 17:19:33 user nova-compute[75100]:   <name>instance-00000005</name>
Nov 13 17:19:33 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:19:33 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:19:33 user nova-compute[75100]:   <metadata>
Nov 13 17:19:33 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:19:33 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:19:33 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherA-server-1834635745</nova:name>
Nov 13 17:19:33 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:19:33</nova:creationTime>
Nov 13 17:19:33 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:19:33 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:19:33 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:19:33 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:19:33 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:19:33 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:19:33 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:19:33 user nova-compute[75100]:       <nova:owner>
Nov 13 17:19:33 user nova-compute[75100]:         <nova:user uuid="7ea28cc48696459f96e7ad8dacad33da">tempest-ServerActionsTestOtherA-226710821-project-member</nova:user>
Nov 13 17:19:33 user nova-compute[75100]:         <nova:project uuid="119dde6420324f52a165a5610c77d1c3">tempest-ServerActionsTestOtherA-226710821</nova:project>
Nov 13 17:19:33 user nova-compute[75100]:       </nova:owner>
Nov 13 17:19:33 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:19:33 user nova-compute[75100]:       <nova:ports>
Nov 13 17:19:33 user nova-compute[75100]:         <nova:port uuid="15335f7b-d811-486f-a5ce-3643fa79fbc7">
Nov 13 17:19:33 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:19:33 user nova-compute[75100]:         </nova:port>
Nov 13 17:19:33 user nova-compute[75100]:       </nova:ports>
Nov 13 17:19:33 user nova-compute[75100]:     </nova:instance>
Nov 13 17:19:33 user nova-compute[75100]:   </metadata>
Nov 13 17:19:33 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:19:33 user nova-compute[75100]:     <system>
Nov 13 17:19:33 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:19:33 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:19:33 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:19:33 user nova-compute[75100]:       <entry name="serial">b0c1af59-f1bd-4c02-8843-e477cd7169d8</entry>
Nov 13 17:19:33 user nova-compute[75100]:       <entry name="uuid">b0c1af59-f1bd-4c02-8843-e477cd7169d8</entry>
Nov 13 17:19:33 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:19:33 user nova-compute[75100]:     </system>
Nov 13 17:19:33 user nova-compute[75100]:   </sysinfo>
Nov 13 17:19:33 user nova-compute[75100]:   <os>
Nov 13 17:19:33 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:19:33 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:19:33 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:19:33 user nova-compute[75100]:   </os>
Nov 13 17:19:33 user nova-compute[75100]:   <features>
Nov 13 17:19:33 user nova-compute[75100]:     <acpi/>
Nov 13 17:19:33 user nova-compute[75100]:     <apic/>
Nov 13 17:19:33 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:19:33 user nova-compute[75100]:   </features>
Nov 13 17:19:33 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:19:33 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:19:33 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:19:33 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:19:33 user nova-compute[75100]:   </clock>
Nov 13 17:19:33 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:19:33 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:19:33 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:19:33 user nova-compute[75100]:   </cpu>
Nov 13 17:19:33 user nova-compute[75100]:   <devices>
Nov 13 17:19:33 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:19:33 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:19:33 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk"/>
Nov 13 17:19:33 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:19:33 user nova-compute[75100]:     </disk>
Nov 13 17:19:33 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:19:33 user nova-compute[75100]:       <mac address="fa:16:3e:1c:8a:63"/>
Nov 13 17:19:33 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:33 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:19:33 user nova-compute[75100]:       <target dev="tap15335f7b-d8"/>
Nov 13 17:19:33 user nova-compute[75100]:     </interface>
Nov 13 17:19:33 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:19:33 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/console.log" append="off"/>
Nov 13 17:19:33 user nova-compute[75100]:     </serial>
Nov 13 17:19:33 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:19:33 user nova-compute[75100]:     <video>
Nov 13 17:19:33 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:33 user nova-compute[75100]:     </video>
Nov 13 17:19:33 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:19:33 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:19:33 user nova-compute[75100]:     </rng>
Nov 13 17:19:33 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:19:33 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:19:33 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:19:33 user nova-compute[75100]:     </memballoon>
Nov 13 17:19:33 user nova-compute[75100]:   </devices>
Nov 13 17:19:33 user nova-compute[75100]: </domain>
Nov 13 17:19:33 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1834635745',display_name='tempest-ServerActionsTestOtherA-server-1834635745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1834635745',id=5,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArXX8H/F/4k/bCD26MQyJfYc6kVyijAa21ATX3s9SJ4y/SgOLDqvjWXABytQ7Y0rezN8922Yqg0PmzPzy90j9+erJSCwuQJnigd+guQkVWmuyFrLUQ16eK1oB+ijXr+Rw==',key_name='tempest-keypair-216019137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-i2xj0rnj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=b0c1af59-f1bd-4c02-8843-e477cd7169d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8a:63,bridge_name='br-int',has_traffic_filtering=True,id=15335f7b-d811-486f-a5ce-3643fa79fbc7,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15335f7b-d8') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG os_vif [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8a:63,bridge_name='br-int',has_traffic_filtering=True,id=15335f7b-d811-486f-a5ce-3643fa79fbc7,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15335f7b-d8') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afbfe27b-059a-5857-8faa-0814c1cea09c', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15335f7b-d8, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15335f7b-d8, col_values=(('qos', UUID('1bfaa87c-7e75-4ee6-bd29-ce1f0250cc92')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15335f7b-d8, col_values=(('external_ids', {'iface-id': '15335f7b-d811-486f-a5ce-3643fa79fbc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:8a:63', 'vm-uuid': 'b0c1af59-f1bd-4c02-8843-e477cd7169d8'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:33 user nova-compute[75100]: INFO os_vif [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:8a:63,bridge_name='br-int',has_traffic_filtering=True,id=15335f7b-d811-486f-a5ce-3643fa79fbc7,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15335f7b-d8')
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No VIF found with MAC fa:16:3e:1c:8a:63, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:19:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-43eb1f06-8c1f-4711-bbe8-174749d67260 req-efac0328-0a99-4c35-90cd-900835dba03a service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updated VIF entry in instance network info cache for port 15335f7b-d811-486f-a5ce-3643fa79fbc7. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-43eb1f06-8c1f-4711-bbe8-174749d67260 req-efac0328-0a99-4c35-90cd-900835dba03a service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updating instance_info_cache with network_info: [{"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-43eb1f06-8c1f-4711-bbe8-174749d67260 req-efac0328-0a99-4c35-90cd-900835dba03a service nova] Releasing lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Successfully updated port: 4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquired lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-038b67de-5a33-4f59-9f04-82763a8f3597 req-a5a921ac-743b-403d-83db-80bc3ac94932 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-changed-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-038b67de-5a33-4f59-9f04-82763a8f3597 req-a5a921ac-743b-403d-83db-80bc3ac94932 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Refreshing instance network info cache due to event network-changed-4d8ea93b-b607-4f22-ad01-9577465b5997. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-038b67de-5a33-4f59-9f04-82763a8f3597 req-a5a921ac-743b-403d-83db-80bc3ac94932 service nova] Acquiring lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating instance_info_cache with network_info: [{"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Releasing lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Instance network_info: |[{"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-038b67de-5a33-4f59-9f04-82763a8f3597 req-a5a921ac-743b-403d-83db-80bc3ac94932 service nova] Acquired lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-038b67de-5a33-4f59-9f04-82763a8f3597 req-a5a921ac-743b-403d-83db-80bc3ac94932 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Refreshing network info cache for port 4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:19:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Start _get_guest_xml network_info=[{"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:19:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-038b67de-5a33-4f59-9f04-82763a8f3597 req-a5a921ac-743b-403d-83db-80bc3ac94932 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updated VIF entry in instance network info cache for port 4d8ea93b-b607-4f22-ad01-9577465b5997. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:19:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-038b67de-5a33-4f59-9f04-82763a8f3597 req-a5a921ac-743b-403d-83db-80bc3ac94932 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating instance_info_cache with network_info: [{"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-038b67de-5a33-4f59-9f04-82763a8f3597 req-a5a921ac-743b-403d-83db-80bc3ac94932 service nova] Releasing lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:19:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Instance spawned successfully.
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:19:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Instance spawned successfully.
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:19:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:19:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Instance spawned successfully.
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Instance spawned successfully.
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1879098934',display_name='tempest-ServerActionsTestOtherB-server-1879098934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1879098934',id=6,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtAAW3TgTxHf+TUITy0Mmc2phtGIX31UWPLC6Ax00Ra3rvR7rorviHUXMJmTRs8r7vW2IjeukFIO8Ah6Z/JWvZwng0Wq3UlZJ7OxB5Mha2gh4q+d5taNiDQoe9oXIHuA==',key_name='tempest-keypair-2067438742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fa1230bfae049af9ce657d6889eddad',ramdisk_id='',reservation_id='r-78tnxuif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1067719084',owner_user_name='tempest-ServerActionsTestOtherB-1067719084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='047fae6bc2134ea2a43fb06dbeabbb0b',uuid=64c9f78b-8ce5-4328-9fb0-93715df6135f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converting VIF {"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.objects.instance [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lazy-loading 'pci_devices' on Instance uuid 64c9f78b-8ce5-4328-9fb0-93715df6135f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:19:41 user nova-compute[75100]:   <uuid>64c9f78b-8ce5-4328-9fb0-93715df6135f</uuid>
Nov 13 17:19:41 user nova-compute[75100]:   <name>instance-00000006</name>
Nov 13 17:19:41 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:19:41 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:19:41 user nova-compute[75100]:   <metadata>
Nov 13 17:19:41 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:19:41 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:19:41 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherB-server-1879098934</nova:name>
Nov 13 17:19:41 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:19:41</nova:creationTime>
Nov 13 17:19:41 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:19:41 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:19:41 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:19:41 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:19:41 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:19:41 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:19:41 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:19:41 user nova-compute[75100]:       <nova:owner>
Nov 13 17:19:41 user nova-compute[75100]:         <nova:user uuid="047fae6bc2134ea2a43fb06dbeabbb0b">tempest-ServerActionsTestOtherB-1067719084-project-member</nova:user>
Nov 13 17:19:41 user nova-compute[75100]:         <nova:project uuid="1fa1230bfae049af9ce657d6889eddad">tempest-ServerActionsTestOtherB-1067719084</nova:project>
Nov 13 17:19:41 user nova-compute[75100]:       </nova:owner>
Nov 13 17:19:41 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:19:41 user nova-compute[75100]:       <nova:ports>
Nov 13 17:19:41 user nova-compute[75100]:         <nova:port uuid="4d8ea93b-b607-4f22-ad01-9577465b5997">
Nov 13 17:19:41 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:19:41 user nova-compute[75100]:         </nova:port>
Nov 13 17:19:41 user nova-compute[75100]:       </nova:ports>
Nov 13 17:19:41 user nova-compute[75100]:     </nova:instance>
Nov 13 17:19:41 user nova-compute[75100]:   </metadata>
Nov 13 17:19:41 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:19:41 user nova-compute[75100]:     <system>
Nov 13 17:19:41 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:19:41 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:19:41 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:19:41 user nova-compute[75100]:       <entry name="serial">64c9f78b-8ce5-4328-9fb0-93715df6135f</entry>
Nov 13 17:19:41 user nova-compute[75100]:       <entry name="uuid">64c9f78b-8ce5-4328-9fb0-93715df6135f</entry>
Nov 13 17:19:41 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:19:41 user nova-compute[75100]:     </system>
Nov 13 17:19:41 user nova-compute[75100]:   </sysinfo>
Nov 13 17:19:41 user nova-compute[75100]:   <os>
Nov 13 17:19:41 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:19:41 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:19:41 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:19:41 user nova-compute[75100]:   </os>
Nov 13 17:19:41 user nova-compute[75100]:   <features>
Nov 13 17:19:41 user nova-compute[75100]:     <acpi/>
Nov 13 17:19:41 user nova-compute[75100]:     <apic/>
Nov 13 17:19:41 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:19:41 user nova-compute[75100]:   </features>
Nov 13 17:19:41 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:19:41 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:19:41 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:19:41 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:19:41 user nova-compute[75100]:   </clock>
Nov 13 17:19:41 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:19:41 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:19:41 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:19:41 user nova-compute[75100]:   </cpu>
Nov 13 17:19:41 user nova-compute[75100]:   <devices>
Nov 13 17:19:41 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:19:41 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:19:41 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk"/>
Nov 13 17:19:41 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:19:41 user nova-compute[75100]:     </disk>
Nov 13 17:19:41 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:19:41 user nova-compute[75100]:       <mac address="fa:16:3e:f0:3f:b9"/>
Nov 13 17:19:41 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:41 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:19:41 user nova-compute[75100]:       <target dev="tap4d8ea93b-b6"/>
Nov 13 17:19:41 user nova-compute[75100]:     </interface>
Nov 13 17:19:41 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:19:41 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/console.log" append="off"/>
Nov 13 17:19:41 user nova-compute[75100]:     </serial>
Nov 13 17:19:41 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:19:41 user nova-compute[75100]:     <video>
Nov 13 17:19:41 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:41 user nova-compute[75100]:     </video>
Nov 13 17:19:41 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:19:41 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:19:41 user nova-compute[75100]:     </rng>
Nov 13 17:19:41 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:19:41 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:19:41 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:19:41 user nova-compute[75100]:     </memballoon>
Nov 13 17:19:41 user nova-compute[75100]:   </devices>
Nov 13 17:19:41 user nova-compute[75100]: </domain>
Nov 13 17:19:41 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1879098934',display_name='tempest-ServerActionsTestOtherB-server-1879098934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1879098934',id=6,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtAAW3TgTxHf+TUITy0Mmc2phtGIX31UWPLC6Ax00Ra3rvR7rorviHUXMJmTRs8r7vW2IjeukFIO8Ah6Z/JWvZwng0Wq3UlZJ7OxB5Mha2gh4q+d5taNiDQoe9oXIHuA==',key_name='tempest-keypair-2067438742',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fa1230bfae049af9ce657d6889eddad',ramdisk_id='',reservation_id='r-78tnxuif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1067719084',owner_user_name='tempest-ServerActionsTestOtherB-1067719084-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='047fae6bc2134ea2a43fb06dbeabbb0b',uuid=64c9f78b-8ce5-4328-9fb0-93715df6135f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converting VIF {"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG os_vif [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48e89590-f317-5f0c-a697-dcd434c33537', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d8ea93b-b6, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d8ea93b-b6, col_values=(('qos', UUID('e528be09-02e3-4808-9577-8872206e3a0d')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d8ea93b-b6, col_values=(('external_ids', {'iface-id': '4d8ea93b-b607-4f22-ad01-9577465b5997', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:3f:b9', 'vm-uuid': '64c9f78b-8ce5-4328-9fb0-93715df6135f'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:41 user nova-compute[75100]: INFO nova.compute.manager [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Took 18.46 seconds to spawn the instance on the hypervisor.
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:41 user nova-compute[75100]: INFO os_vif [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6')
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:19:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Instance spawned successfully.
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] No VIF found with MAC fa:16:3e:f0:3f:b9, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:19:41 user nova-compute[75100]: INFO nova.compute.manager [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Took 15.36 seconds to spawn the instance on the hypervisor.
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:42 user nova-compute[75100]: INFO nova.compute.manager [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Took 19.80 seconds to spawn the instance on the hypervisor.
Nov 13 17:19:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:19:42 user nova-compute[75100]: INFO nova.compute.manager [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Took 16.78 seconds to build instance.
Nov 13 17:19:42 user nova-compute[75100]: INFO nova.compute.manager [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Took 14.06 seconds to spawn the instance on the hypervisor.
Nov 13 17:19:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:19:42 user nova-compute[75100]: INFO nova.compute.manager [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Took 17.09 seconds to spawn the instance on the hypervisor.
Nov 13 17:19:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:19:42 user nova-compute[75100]: INFO nova.compute.manager [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Took 20.02 seconds to build instance.
Nov 13 17:19:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d32f9f9b-89b5-4528-aedd-981c38bcf6f0 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.942s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bacbe4d2-1219-4425-9d8f-936411c163aa tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.254s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:42 user nova-compute[75100]: INFO nova.compute.manager [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Took 20.90 seconds to build instance.
Nov 13 17:19:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-db67b679-7e65-48bb-be5b-0c050e6b2564 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "31779592-a9f2-4aae-a658-e055ec832b37" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.246s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:42 user nova-compute[75100]: INFO nova.compute.manager [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Took 15.05 seconds to build instance.
Nov 13 17:19:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dbee03bf-d669-45c2-bafd-07fde92e9dce tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.222s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:42 user nova-compute[75100]: INFO nova.compute.manager [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Took 18.40 seconds to build instance.
Nov 13 17:19:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb464580-8d08-42a0-959b-ae6869384c34 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.593s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-4412c010-b376-44fe-8d42-71502cf9cd01 req-6ca4ba31-9f69-4b6a-8351-c5d3d9462183 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4412c010-b376-44fe-8d42-71502cf9cd01 req-6ca4ba31-9f69-4b6a-8351-c5d3d9462183 service nova] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4412c010-b376-44fe-8d42-71502cf9cd01 req-6ca4ba31-9f69-4b6a-8351-c5d3d9462183 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4412c010-b376-44fe-8d42-71502cf9cd01 req-6ca4ba31-9f69-4b6a-8351-c5d3d9462183 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-4412c010-b376-44fe-8d42-71502cf9cd01 req-6ca4ba31-9f69-4b6a-8351-c5d3d9462183 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] No waiting events found dispatching network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:19:45 user nova-compute[75100]: WARNING nova.compute.manager [req-4412c010-b376-44fe-8d42-71502cf9cd01 req-6ca4ba31-9f69-4b6a-8351-c5d3d9462183 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received unexpected event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 for instance with vm_state active and task_state None.
Nov 13 17:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-0e36a40c-c918-4fc5-b724-2e3866c94fc0 req-61c05eea-18e2-4dbc-a05e-4946de1f8ec9 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Received event network-vif-plugged-b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0e36a40c-c918-4fc5-b724-2e3866c94fc0 req-61c05eea-18e2-4dbc-a05e-4946de1f8ec9 service nova] Acquiring lock "31779592-a9f2-4aae-a658-e055ec832b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0e36a40c-c918-4fc5-b724-2e3866c94fc0 req-61c05eea-18e2-4dbc-a05e-4946de1f8ec9 service nova] Lock "31779592-a9f2-4aae-a658-e055ec832b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0e36a40c-c918-4fc5-b724-2e3866c94fc0 req-61c05eea-18e2-4dbc-a05e-4946de1f8ec9 service nova] Lock "31779592-a9f2-4aae-a658-e055ec832b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-0e36a40c-c918-4fc5-b724-2e3866c94fc0 req-61c05eea-18e2-4dbc-a05e-4946de1f8ec9 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] No waiting events found dispatching network-vif-plugged-b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:19:46 user nova-compute[75100]: WARNING nova.compute.manager [req-0e36a40c-c918-4fc5-b724-2e3866c94fc0 req-61c05eea-18e2-4dbc-a05e-4946de1f8ec9 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Received unexpected event network-vif-plugged-b88af3f7-eb48-47b2-84c0-b991584a6826 for instance with vm_state active and task_state None.
Nov 13 17:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:19:47 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Instance spawned successfully.
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-5bd67130-1610-4ba0-be45-845138925f6a req-2ff864d1-7792-4ec9-96af-3ca46d894f78 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bd67130-1610-4ba0-be45-845138925f6a req-2ff864d1-7792-4ec9-96af-3ca46d894f78 service nova] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bd67130-1610-4ba0-be45-845138925f6a req-2ff864d1-7792-4ec9-96af-3ca46d894f78 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bd67130-1610-4ba0-be45-845138925f6a req-2ff864d1-7792-4ec9-96af-3ca46d894f78 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-5bd67130-1610-4ba0-be45-845138925f6a req-2ff864d1-7792-4ec9-96af-3ca46d894f78 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] No waiting events found dispatching network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:19:47 user nova-compute[75100]: WARNING nova.compute.manager [req-5bd67130-1610-4ba0-be45-845138925f6a req-2ff864d1-7792-4ec9-96af-3ca46d894f78 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received unexpected event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 for instance with vm_state active and task_state None.
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-5bd67130-1610-4ba0-be45-845138925f6a req-2ff864d1-7792-4ec9-96af-3ca46d894f78 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received event network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bd67130-1610-4ba0-be45-845138925f6a req-2ff864d1-7792-4ec9-96af-3ca46d894f78 service nova] Acquiring lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bd67130-1610-4ba0-be45-845138925f6a req-2ff864d1-7792-4ec9-96af-3ca46d894f78 service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5bd67130-1610-4ba0-be45-845138925f6a req-2ff864d1-7792-4ec9-96af-3ca46d894f78 service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-5bd67130-1610-4ba0-be45-845138925f6a req-2ff864d1-7792-4ec9-96af-3ca46d894f78 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] No waiting events found dispatching network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:19:47 user nova-compute[75100]: WARNING nova.compute.manager [req-5bd67130-1610-4ba0-be45-845138925f6a req-2ff864d1-7792-4ec9-96af-3ca46d894f78 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received unexpected event network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad for instance with vm_state active and task_state None.
Nov 13 17:19:47 user nova-compute[75100]: INFO nova.compute.manager [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Took 18.04 seconds to spawn the instance on the hypervisor.
Nov 13 17:19:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:19:48 user nova-compute[75100]: INFO nova.compute.manager [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Took 19.15 seconds to build instance.
Nov 13 17:19:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-65bb858f-e472-41cb-b00b-71d0401fdf4a tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.280s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-492f6de5-a435-48cd-846d-d03b9c0128e9 req-db772490-25c2-4118-9ff3-9f2adb00b8ed service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Received event network-vif-plugged-b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-492f6de5-a435-48cd-846d-d03b9c0128e9 req-db772490-25c2-4118-9ff3-9f2adb00b8ed service nova] Acquiring lock "31779592-a9f2-4aae-a658-e055ec832b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-492f6de5-a435-48cd-846d-d03b9c0128e9 req-db772490-25c2-4118-9ff3-9f2adb00b8ed service nova] Lock "31779592-a9f2-4aae-a658-e055ec832b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-492f6de5-a435-48cd-846d-d03b9c0128e9 req-db772490-25c2-4118-9ff3-9f2adb00b8ed service nova] Lock "31779592-a9f2-4aae-a658-e055ec832b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-492f6de5-a435-48cd-846d-d03b9c0128e9 req-db772490-25c2-4118-9ff3-9f2adb00b8ed service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] No waiting events found dispatching network-vif-plugged-b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:19:48 user nova-compute[75100]: WARNING nova.compute.manager [req-492f6de5-a435-48cd-846d-d03b9c0128e9 req-db772490-25c2-4118-9ff3-9f2adb00b8ed service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Received unexpected event network-vif-plugged-b88af3f7-eb48-47b2-84c0-b991584a6826 for instance with vm_state active and task_state None.
Nov 13 17:19:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received event network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] Acquiring lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] No waiting events found dispatching network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:19:49 user nova-compute[75100]: WARNING nova.compute.manager [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received unexpected event network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad for instance with vm_state active and task_state None.
Nov 13 17:19:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Received event network-vif-plugged-d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] Acquiring lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] No waiting events found dispatching network-vif-plugged-d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:19:49 user nova-compute[75100]: WARNING nova.compute.manager [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Received unexpected event network-vif-plugged-d655d771-6c6c-49e9-89da-810f79e78314 for instance with vm_state active and task_state None.
Nov 13 17:19:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Received event network-vif-plugged-d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] Acquiring lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] No waiting events found dispatching network-vif-plugged-d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:19:49 user nova-compute[75100]: WARNING nova.compute.manager [req-3f0d3a70-0188-44e5-a7b7-804474e6d3d7 req-b9327556-cb22-4a3b-9d44-b1838fa21dca service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Received unexpected event network-vif-plugged-d655d771-6c6c-49e9-89da-810f79e78314 for instance with vm_state active and task_state None.
Nov 13 17:19:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:19:51 user nova-compute[75100]: INFO nova.compute.claims [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Claim successful on node user
Nov 13 17:19:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-86b609a3-8c30-44f6-820d-207128111644 req-8491a588-a52c-40bc-a6dc-91db76039eb8 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86b609a3-8c30-44f6-820d-207128111644 req-8491a588-a52c-40bc-a6dc-91db76039eb8 service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86b609a3-8c30-44f6-820d-207128111644 req-8491a588-a52c-40bc-a6dc-91db76039eb8 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86b609a3-8c30-44f6-820d-207128111644 req-8491a588-a52c-40bc-a6dc-91db76039eb8 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-86b609a3-8c30-44f6-820d-207128111644 req-8491a588-a52c-40bc-a6dc-91db76039eb8 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:19:52 user nova-compute[75100]: WARNING nova.compute.manager [req-86b609a3-8c30-44f6-820d-207128111644 req-8491a588-a52c-40bc-a6dc-91db76039eb8 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state active and task_state None.
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-86b609a3-8c30-44f6-820d-207128111644 req-8491a588-a52c-40bc-a6dc-91db76039eb8 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86b609a3-8c30-44f6-820d-207128111644 req-8491a588-a52c-40bc-a6dc-91db76039eb8 service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86b609a3-8c30-44f6-820d-207128111644 req-8491a588-a52c-40bc-a6dc-91db76039eb8 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86b609a3-8c30-44f6-820d-207128111644 req-8491a588-a52c-40bc-a6dc-91db76039eb8 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-86b609a3-8c30-44f6-820d-207128111644 req-8491a588-a52c-40bc-a6dc-91db76039eb8 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:19:52 user nova-compute[75100]: WARNING nova.compute.manager [req-86b609a3-8c30-44f6-820d-207128111644 req-8491a588-a52c-40bc-a6dc-91db76039eb8 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state active and task_state None.
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.754s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.089s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:19:52 user nova-compute[75100]: INFO nova.compute.claims [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Claim successful on node user
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:19:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.policy [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f4f73d50c8d6444a8781e92683eeba00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3f2a4991fba445f8c8092a7575c7480', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:19:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Creating image(s)
Nov 13 17:19:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "/opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "/opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "/opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.804s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:19:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.368s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Successfully created port: 17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.261s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:19:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Creating image(s)
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "/opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "/opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "f38b843469335f4bfb4f737713b1e7c0f1cce559" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "f38b843469335f4bfb4f737713b1e7c0f1cce559" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk 1073741824" returned: 0 in 0.082s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:53 user nova-compute[75100]: DEBUG nova.policy [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f346412051341acaad45c7e3ed974c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '078f6299ef104b968a06e3e9cd6dd5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.844s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559.part --force-share --output=json" returned: 0 in 0.300s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG nova.virt.images [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] 857f07b6-9fc2-45c9-bc43-cae739b24535 was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559.part /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Cannot resize image /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Ensure instance console log exists: /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Successfully updated port: 17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "refresh_cache-d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquired lock "refresh_cache-d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-602081a1-344f-47c5-a526-834836335667 req-770a76fa-f0b7-4291-a663-2dc3427d5847 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Received event network-changed-17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-602081a1-344f-47c5-a526-834836335667 req-770a76fa-f0b7-4291-a663-2dc3427d5847 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Refreshing instance network info cache due to event network-changed-17b414e0-be01-45df-9ae4-0a9be2c8b4cd. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:19:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-602081a1-344f-47c5-a526-834836335667 req-770a76fa-f0b7-4291-a663-2dc3427d5847 service nova] Acquiring lock "refresh_cache-d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Updating instance_info_cache with network_info: [{"id": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "address": "fa:16:3e:3e:c6:e4", "network": {"id": "f70775c3-a96e-44f5-88b8-e6d63ee78d51", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257528124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f2a4991fba445f8c8092a7575c7480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17b414e0-be", "ovs_interfaceid": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559.part /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559.converted" returned: 0 in 0.799s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Releasing lock "refresh_cache-d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Instance network_info: |[{"id": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "address": "fa:16:3e:3e:c6:e4", "network": {"id": "f70775c3-a96e-44f5-88b8-e6d63ee78d51", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257528124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f2a4991fba445f8c8092a7575c7480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17b414e0-be", "ovs_interfaceid": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-602081a1-344f-47c5-a526-834836335667 req-770a76fa-f0b7-4291-a663-2dc3427d5847 service nova] Acquired lock "refresh_cache-d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-602081a1-344f-47c5-a526-834836335667 req-770a76fa-f0b7-4291-a663-2dc3427d5847 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Refreshing network info cache for port 17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Start _get_guest_xml network_info=[{"id": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "address": "fa:16:3e:3e:c6:e4", "network": {"id": "f70775c3-a96e-44f5-88b8-e6d63ee78d51", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257528124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f2a4991fba445f8c8092a7575c7480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17b414e0-be", "ovs_interfaceid": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Acquiring lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:19:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1325451567',display_name='tempest-TestVolumeSwap-server-1325451567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1325451567',id=7,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmLA/YJAMaL+GKdFe0GdhCPRpSy0iZUDfY4Vw0MV3iqhmilf1aJqud9w+Rmvkrsrl8nTlEnsCgh88bx9PVVBS8asPE8m4rLQMpou59Yv67lan7RQRnYUSHHRN38sqJiIQ==',key_name='tempest-keypair-920829371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3f2a4991fba445f8c8092a7575c7480',ramdisk_id='',reservation_id='r-n808uex1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-732461591',owner_user_name='tempest-TestVolumeSwap-732461591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f73d50c8d6444a8781e92683eeba00',uuid=d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "address": "fa:16:3e:3e:c6:e4", "network": {"id": "f70775c3-a96e-44f5-88b8-e6d63ee78d51", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257528124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f2a4991fba445f8c8092a7575c7480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17b414e0-be", "ovs_interfaceid": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Converting VIF {"id": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "address": "fa:16:3e:3e:c6:e4", "network": {"id": "f70775c3-a96e-44f5-88b8-e6d63ee78d51", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257528124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f2a4991fba445f8c8092a7575c7480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17b414e0-be", "ovs_interfaceid": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=17b414e0-be01-45df-9ae4-0a9be2c8b4cd,network=Network(f70775c3-a96e-44f5-88b8-e6d63ee78d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17b414e0-be') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lazy-loading 'pci_devices' on Instance uuid d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559.converted --force-share --output=json" returned: 0 in 0.410s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "f38b843469335f4bfb4f737713b1e7c0f1cce559" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.332s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:19:56 user nova-compute[75100]:   <uuid>d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f</uuid>
Nov 13 17:19:56 user nova-compute[75100]:   <name>instance-00000007</name>
Nov 13 17:19:56 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:19:56 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:19:56 user nova-compute[75100]:   <metadata>
Nov 13 17:19:56 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:19:56 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:19:56 user nova-compute[75100]:       <nova:name>tempest-TestVolumeSwap-server-1325451567</nova:name>
Nov 13 17:19:56 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:19:55</nova:creationTime>
Nov 13 17:19:56 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:19:56 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:19:56 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:19:56 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:19:56 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:19:56 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:19:56 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:19:56 user nova-compute[75100]:       <nova:owner>
Nov 13 17:19:56 user nova-compute[75100]:         <nova:user uuid="f4f73d50c8d6444a8781e92683eeba00">tempest-TestVolumeSwap-732461591-project-member</nova:user>
Nov 13 17:19:56 user nova-compute[75100]:         <nova:project uuid="b3f2a4991fba445f8c8092a7575c7480">tempest-TestVolumeSwap-732461591</nova:project>
Nov 13 17:19:56 user nova-compute[75100]:       </nova:owner>
Nov 13 17:19:56 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:19:56 user nova-compute[75100]:       <nova:ports>
Nov 13 17:19:56 user nova-compute[75100]:         <nova:port uuid="17b414e0-be01-45df-9ae4-0a9be2c8b4cd">
Nov 13 17:19:56 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 17:19:56 user nova-compute[75100]:         </nova:port>
Nov 13 17:19:56 user nova-compute[75100]:       </nova:ports>
Nov 13 17:19:56 user nova-compute[75100]:     </nova:instance>
Nov 13 17:19:56 user nova-compute[75100]:   </metadata>
Nov 13 17:19:56 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:19:56 user nova-compute[75100]:     <system>
Nov 13 17:19:56 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:19:56 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:19:56 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:19:56 user nova-compute[75100]:       <entry name="serial">d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f</entry>
Nov 13 17:19:56 user nova-compute[75100]:       <entry name="uuid">d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f</entry>
Nov 13 17:19:56 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:19:56 user nova-compute[75100]:     </system>
Nov 13 17:19:56 user nova-compute[75100]:   </sysinfo>
Nov 13 17:19:56 user nova-compute[75100]:   <os>
Nov 13 17:19:56 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:19:56 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:19:56 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:19:56 user nova-compute[75100]:   </os>
Nov 13 17:19:56 user nova-compute[75100]:   <features>
Nov 13 17:19:56 user nova-compute[75100]:     <acpi/>
Nov 13 17:19:56 user nova-compute[75100]:     <apic/>
Nov 13 17:19:56 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:19:56 user nova-compute[75100]:   </features>
Nov 13 17:19:56 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:19:56 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:19:56 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:19:56 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:19:56 user nova-compute[75100]:   </clock>
Nov 13 17:19:56 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:19:56 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:19:56 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:19:56 user nova-compute[75100]:   </cpu>
Nov 13 17:19:56 user nova-compute[75100]:   <devices>
Nov 13 17:19:56 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:19:56 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:19:56 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk"/>
Nov 13 17:19:56 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:19:56 user nova-compute[75100]:     </disk>
Nov 13 17:19:56 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:19:56 user nova-compute[75100]:       <mac address="fa:16:3e:3e:c6:e4"/>
Nov 13 17:19:56 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:56 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:19:56 user nova-compute[75100]:       <target dev="tap17b414e0-be"/>
Nov 13 17:19:56 user nova-compute[75100]:     </interface>
Nov 13 17:19:56 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:19:56 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/console.log" append="off"/>
Nov 13 17:19:56 user nova-compute[75100]:     </serial>
Nov 13 17:19:56 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:19:56 user nova-compute[75100]:     <video>
Nov 13 17:19:56 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:19:56 user nova-compute[75100]:     </video>
Nov 13 17:19:56 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:19:56 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:19:56 user nova-compute[75100]:     </rng>
Nov 13 17:19:56 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:19:56 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:19:56 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:19:56 user nova-compute[75100]:     </memballoon>
Nov 13 17:19:56 user nova-compute[75100]:   </devices>
Nov 13 17:19:56 user nova-compute[75100]: </domain>
Nov 13 17:19:56 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1325451567',display_name='tempest-TestVolumeSwap-server-1325451567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1325451567',id=7,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmLA/YJAMaL+GKdFe0GdhCPRpSy0iZUDfY4Vw0MV3iqhmilf1aJqud9w+Rmvkrsrl8nTlEnsCgh88bx9PVVBS8asPE8m4rLQMpou59Yv67lan7RQRnYUSHHRN38sqJiIQ==',key_name='tempest-keypair-920829371',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3f2a4991fba445f8c8092a7575c7480',ramdisk_id='',reservation_id='r-n808uex1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-732461591',owner_user_name='tempest-TestVolumeSwap-732461591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f73d50c8d6444a8781e92683eeba00',uuid=d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "address": "fa:16:3e:3e:c6:e4", "network": {"id": "f70775c3-a96e-44f5-88b8-e6d63ee78d51", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257528124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f2a4991fba445f8c8092a7575c7480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17b414e0-be", "ovs_interfaceid": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Converting VIF {"id": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "address": "fa:16:3e:3e:c6:e4", "network": {"id": "f70775c3-a96e-44f5-88b8-e6d63ee78d51", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257528124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f2a4991fba445f8c8092a7575c7480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17b414e0-be", "ovs_interfaceid": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=17b414e0-be01-45df-9ae4-0a9be2c8b4cd,network=Network(f70775c3-a96e-44f5-88b8-e6d63ee78d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17b414e0-be') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG os_vif [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=17b414e0-be01-45df-9ae4-0a9be2c8b4cd,network=Network(f70775c3-a96e-44f5-88b8-e6d63ee78d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17b414e0-be') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21d37820-8605-5800-acdf-e14d440850e8', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:19:56 user nova-compute[75100]: INFO nova.compute.claims [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Claim successful on node user
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17b414e0-be, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17b414e0-be, col_values=(('qos', UUID('c28c6c54-45dd-4f33-9376-eeafd64960cb')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17b414e0-be, col_values=(('external_ids', {'iface-id': '17b414e0-be01-45df-9ae4-0a9be2c8b4cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:c6:e4', 'vm-uuid': 'd88fd6b4-8e19-4b0a-a6d4-761187cd3c0f'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:56 user nova-compute[75100]: INFO os_vif [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=17b414e0-be01-45df-9ae4-0a9be2c8b4cd,network=Network(f70775c3-a96e-44f5-88b8-e6d63ee78d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17b414e0-be')
Nov 13 17:19:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559 --force-share --output=json" returned: 0 in 0.243s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "f38b843469335f4bfb4f737713b1e7c0f1cce559" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "f38b843469335f4bfb4f737713b1e7c0f1cce559" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] No VIF found with MAC fa:16:3e:3e:c6:e4, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559 --force-share --output=json" returned: 0 in 0.279s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559,backing_fmt=raw /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559,backing_fmt=raw /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk 1073741824" returned: 0 in 0.258s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "f38b843469335f4bfb4f737713b1e7c0f1cce559" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.544s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-602081a1-344f-47c5-a526-834836335667 req-770a76fa-f0b7-4291-a663-2dc3427d5847 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Updated VIF entry in instance network info cache for port 17b414e0-be01-45df-9ae4-0a9be2c8b4cd. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-602081a1-344f-47c5-a526-834836335667 req-770a76fa-f0b7-4291-a663-2dc3427d5847 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Updating instance_info_cache with network_info: [{"id": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "address": "fa:16:3e:3e:c6:e4", "network": {"id": "f70775c3-a96e-44f5-88b8-e6d63ee78d51", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257528124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f2a4991fba445f8c8092a7575c7480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17b414e0-be", "ovs_interfaceid": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:19:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-602081a1-344f-47c5-a526-834836335667 req-770a76fa-f0b7-4291-a663-2dc3427d5847 service nova] Releasing lock "refresh_cache-d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559 --force-share --output=json" returned: 0 in 0.244s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.189s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk --force-share --output=json" returned: 0 in 0.408s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Cannot resize image /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Ensure instance console log exists: /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Successfully created port: bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.policy [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f5cc4868e77e468cae8b8fd0c29f2358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633318b44b824f79a91e414700c3bc97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:19:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Creating image(s)
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Acquiring lock "/opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "/opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "/opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.287s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.294s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk 1073741824" returned: 0 in 0.128s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.430s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.324s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "5ead8372-787b-41f8-95cc-11dd49093606" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.018s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Cannot resize image /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Ensure instance console log exists: /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:19:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:19:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:19:59 user nova-compute[75100]: INFO nova.compute.claims [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Claim successful on node user
Nov 13 17:19:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Successfully created port: a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:19:59 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:19:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:59 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:19:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:19:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.824s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:19:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Successfully updated port: bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "refresh_cache-7b8c5beb-5551-48b0-8331-bfcba175cc0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquired lock "refresh_cache-7b8c5beb-5551-48b0-8331-bfcba175cc0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:20:00 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-62158d62-4cd1-4e7e-bcac-5c4b83a617da req-b40b1a09-c4d3-445c-9e4e-df9a7aef4144 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Received event network-changed-bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-62158d62-4cd1-4e7e-bcac-5c4b83a617da req-b40b1a09-c4d3-445c-9e4e-df9a7aef4144 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Refreshing instance network info cache due to event network-changed-bd9178d4-3984-4df2-8531-8dd8f4da4510. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-62158d62-4cd1-4e7e-bcac-5c4b83a617da req-b40b1a09-c4d3-445c-9e4e-df9a7aef4144 service nova] Acquiring lock "refresh_cache-7b8c5beb-5551-48b0-8331-bfcba175cc0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:20:00 user nova-compute[75100]: INFO nova.virt.block_device [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Booting with volume c111e555-d452-4770-b8c7-853575a07b0b at /dev/vda
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.policy [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f56979d0e374f6ea4be1920f5f62fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5af88d50944bbd9e6ec2ae84f194d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG os_brick.utils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:20:00 user nova-compute[75100]: INFO oslo.privsep.daemon [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpd8pqsmnl/privsep.sock']
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Successfully updated port: a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Updating instance_info_cache with network_info: [{"id": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "address": "fa:16:3e:4b:75:c5", "network": {"id": "17f39e27-bb24-456e-9bb4-6db6772309b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-944565688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078f6299ef104b968a06e3e9cd6dd5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9178d4-39", "ovs_interfaceid": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Acquiring lock "refresh_cache-55c68a33-6003-4b98-a248-f5d3dafe77f1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Acquired lock "refresh_cache-55c68a33-6003-4b98-a248-f5d3dafe77f1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:20:00 user sudo[85566]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpd8pqsmnl/privsep.sock
Nov 13 17:20:00 user sudo[85566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 17:20:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Releasing lock "refresh_cache-7b8c5beb-5551-48b0-8331-bfcba175cc0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Instance network_info: |[{"id": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "address": "fa:16:3e:4b:75:c5", "network": {"id": "17f39e27-bb24-456e-9bb4-6db6772309b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-944565688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078f6299ef104b968a06e3e9cd6dd5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9178d4-39", "ovs_interfaceid": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-62158d62-4cd1-4e7e-bcac-5c4b83a617da req-b40b1a09-c4d3-445c-9e4e-df9a7aef4144 service nova] Acquired lock "refresh_cache-7b8c5beb-5551-48b0-8331-bfcba175cc0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.network.neutron [req-62158d62-4cd1-4e7e-bcac-5c4b83a617da req-b40b1a09-c4d3-445c-9e4e-df9a7aef4144 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Refreshing network info cache for port bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Start _get_guest_xml network_info=[{"id": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "address": "fa:16:3e:4b:75:c5", "network": {"id": "17f39e27-bb24-456e-9bb4-6db6772309b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-944565688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078f6299ef104b968a06e3e9cd6dd5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9178d4-39", "ovs_interfaceid": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:19:39Z,direct_url=<?>,disk_format='qcow2',id=857f07b6-9fc2-45c9-bc43-cae739b24535,min_disk=0,min_ram=0,name='',owner='3ab4e9f32fa94acc884c5c5b83a3ea26',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:19:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'device_name': '/dev/sda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'scsi', 'image_id': '857f07b6-9fc2-45c9-bc43-cae739b24535'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:20:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:20:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:19:39Z,direct_url=<?>,disk_format='qcow2',id=857f07b6-9fc2-45c9-bc43-cae739b24535,min_disk=0,min_ram=0,name='',owner='3ab4e9f32fa94acc884c5c5b83a3ea26',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:19:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1625328849',display_name='tempest-AttachSCSIVolumeTestJSON-server-1625328849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1625328849',id=8,image_ref='857f07b6-9fc2-45c9-bc43-cae739b24535',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+VB5OPtx/uNJgmE3eyN6mqh8Awk15gHnlzzQmk6+WnP1lkiC1y6KRhXi55NU3UUwdE8fCBFyH5dEeqc49l84MOiQTn6iyW4ETWlD1XXyCTpOVayfITW5yBIrIouOL+/g==',key_name='tempest-keypair-860922806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='078f6299ef104b968a06e3e9cd6dd5cb',ramdisk_id='',reservation_id='r-u8wxsl2v',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='857f07b6-9fc2-45c9-bc43-cae739b24535',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-145313973',owner_user_name='tempest-AttachSCSIVolumeTestJSON-145313973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f346412051341acaad45c7e3ed974c3',uuid=7b8c5beb-5551-48b0-8331-bfcba175cc0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "address": "fa:16:3e:4b:75:c5", "network": {"id": "17f39e27-bb24-456e-9bb4-6db6772309b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-944565688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078f6299ef104b968a06e3e9cd6dd5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9178d4-39", "ovs_interfaceid": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Converting VIF {"id": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "address": "fa:16:3e:4b:75:c5", "network": {"id": "17f39e27-bb24-456e-9bb4-6db6772309b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-944565688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078f6299ef104b968a06e3e9cd6dd5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9178d4-39", "ovs_interfaceid": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:75:c5,bridge_name='br-int',has_traffic_filtering=True,id=bd9178d4-3984-4df2-8531-8dd8f4da4510,network=Network(17f39e27-bb24-456e-9bb4-6db6772309b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9178d4-39') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b8c5beb-5551-48b0-8331-bfcba175cc0e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-50f856ad-344c-4663-9647-65db6ce6d6d4 req-da578fbe-dd1f-467c-ab12-4126f8cab140 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Received event network-changed-a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-50f856ad-344c-4663-9647-65db6ce6d6d4 req-da578fbe-dd1f-467c-ab12-4126f8cab140 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Refreshing instance network info cache due to event network-changed-a8348145-5a89-4365-ae02-deeb30863eae. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-50f856ad-344c-4663-9647-65db6ce6d6d4 req-da578fbe-dd1f-467c-ab12-4126f8cab140 service nova] Acquiring lock "refresh_cache-55c68a33-6003-4b98-a248-f5d3dafe77f1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:20:00 user nova-compute[75100]:   <uuid>7b8c5beb-5551-48b0-8331-bfcba175cc0e</uuid>
Nov 13 17:20:00 user nova-compute[75100]:   <name>instance-00000008</name>
Nov 13 17:20:00 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:20:00 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:20:00 user nova-compute[75100]:   <metadata>
Nov 13 17:20:00 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:20:00 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:20:00 user nova-compute[75100]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1625328849</nova:name>
Nov 13 17:20:00 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:20:00</nova:creationTime>
Nov 13 17:20:00 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:20:00 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:20:00 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:20:00 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:20:00 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:20:00 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:20:00 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:20:00 user nova-compute[75100]:       <nova:owner>
Nov 13 17:20:00 user nova-compute[75100]:         <nova:user uuid="4f346412051341acaad45c7e3ed974c3">tempest-AttachSCSIVolumeTestJSON-145313973-project-member</nova:user>
Nov 13 17:20:00 user nova-compute[75100]:         <nova:project uuid="078f6299ef104b968a06e3e9cd6dd5cb">tempest-AttachSCSIVolumeTestJSON-145313973</nova:project>
Nov 13 17:20:00 user nova-compute[75100]:       </nova:owner>
Nov 13 17:20:00 user nova-compute[75100]:       <nova:root type="image" uuid="857f07b6-9fc2-45c9-bc43-cae739b24535"/>
Nov 13 17:20:00 user nova-compute[75100]:       <nova:ports>
Nov 13 17:20:00 user nova-compute[75100]:         <nova:port uuid="bd9178d4-3984-4df2-8531-8dd8f4da4510">
Nov 13 17:20:00 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 17:20:00 user nova-compute[75100]:         </nova:port>
Nov 13 17:20:00 user nova-compute[75100]:       </nova:ports>
Nov 13 17:20:00 user nova-compute[75100]:     </nova:instance>
Nov 13 17:20:00 user nova-compute[75100]:   </metadata>
Nov 13 17:20:00 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:20:00 user nova-compute[75100]:     <system>
Nov 13 17:20:00 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:20:00 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:20:00 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:20:00 user nova-compute[75100]:       <entry name="serial">7b8c5beb-5551-48b0-8331-bfcba175cc0e</entry>
Nov 13 17:20:00 user nova-compute[75100]:       <entry name="uuid">7b8c5beb-5551-48b0-8331-bfcba175cc0e</entry>
Nov 13 17:20:00 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:20:00 user nova-compute[75100]:     </system>
Nov 13 17:20:00 user nova-compute[75100]:   </sysinfo>
Nov 13 17:20:00 user nova-compute[75100]:   <os>
Nov 13 17:20:00 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:20:00 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:20:00 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:20:00 user nova-compute[75100]:   </os>
Nov 13 17:20:00 user nova-compute[75100]:   <features>
Nov 13 17:20:00 user nova-compute[75100]:     <acpi/>
Nov 13 17:20:00 user nova-compute[75100]:     <apic/>
Nov 13 17:20:00 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:20:00 user nova-compute[75100]:   </features>
Nov 13 17:20:00 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:20:00 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:20:00 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:20:00 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:20:00 user nova-compute[75100]:   </clock>
Nov 13 17:20:00 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:20:00 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:20:00 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:20:00 user nova-compute[75100]:   </cpu>
Nov 13 17:20:00 user nova-compute[75100]:   <devices>
Nov 13 17:20:00 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:20:00 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:20:00 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk"/>
Nov 13 17:20:00 user nova-compute[75100]:       <target dev="sda" bus="scsi"/>
Nov 13 17:20:00 user nova-compute[75100]:       <address type="drive" controller="0" unit="0"/>
Nov 13 17:20:00 user nova-compute[75100]:     </disk>
Nov 13 17:20:00 user nova-compute[75100]:     <disk type="file" device="cdrom">
Nov 13 17:20:00 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 17:20:00 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk.config"/>
Nov 13 17:20:00 user nova-compute[75100]:       <target dev="sdb" bus="scsi"/>
Nov 13 17:20:00 user nova-compute[75100]:       <address type="drive" controller="0" unit="1"/>
Nov 13 17:20:00 user nova-compute[75100]:     </disk>
Nov 13 17:20:00 user nova-compute[75100]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 13 17:20:00 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:20:00 user nova-compute[75100]:       <mac address="fa:16:3e:4b:75:c5"/>
Nov 13 17:20:00 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:00 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:20:00 user nova-compute[75100]:       <target dev="tapbd9178d4-39"/>
Nov 13 17:20:00 user nova-compute[75100]:     </interface>
Nov 13 17:20:00 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:20:00 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/console.log" append="off"/>
Nov 13 17:20:00 user nova-compute[75100]:     </serial>
Nov 13 17:20:00 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:20:00 user nova-compute[75100]:     <video>
Nov 13 17:20:00 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:00 user nova-compute[75100]:     </video>
Nov 13 17:20:00 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:20:00 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:20:00 user nova-compute[75100]:     </rng>
Nov 13 17:20:00 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:20:00 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:20:00 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:20:00 user nova-compute[75100]:     </memballoon>
Nov 13 17:20:00 user nova-compute[75100]:   </devices>
Nov 13 17:20:00 user nova-compute[75100]: </domain>
Nov 13 17:20:00 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1625328849',display_name='tempest-AttachSCSIVolumeTestJSON-server-1625328849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1625328849',id=8,image_ref='857f07b6-9fc2-45c9-bc43-cae739b24535',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+VB5OPtx/uNJgmE3eyN6mqh8Awk15gHnlzzQmk6+WnP1lkiC1y6KRhXi55NU3UUwdE8fCBFyH5dEeqc49l84MOiQTn6iyW4ETWlD1XXyCTpOVayfITW5yBIrIouOL+/g==',key_name='tempest-keypair-860922806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='078f6299ef104b968a06e3e9cd6dd5cb',ramdisk_id='',reservation_id='r-u8wxsl2v',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='857f07b6-9fc2-45c9-bc43-cae739b24535',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-145313973',owner_user_name='tempest-AttachSCSIVolumeTestJSON-145313973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f346412051341acaad45c7e3ed974c3',uuid=7b8c5beb-5551-48b0-8331-bfcba175cc0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "address": "fa:16:3e:4b:75:c5", "network": {"id": "17f39e27-bb24-456e-9bb4-6db6772309b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-944565688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078f6299ef104b968a06e3e9cd6dd5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9178d4-39", "ovs_interfaceid": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Converting VIF {"id": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "address": "fa:16:3e:4b:75:c5", "network": {"id": "17f39e27-bb24-456e-9bb4-6db6772309b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-944565688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078f6299ef104b968a06e3e9cd6dd5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9178d4-39", "ovs_interfaceid": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:75:c5,bridge_name='br-int',has_traffic_filtering=True,id=bd9178d4-3984-4df2-8531-8dd8f4da4510,network=Network(17f39e27-bb24-456e-9bb4-6db6772309b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9178d4-39') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG os_vif [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:75:c5,bridge_name='br-int',has_traffic_filtering=True,id=bd9178d4-3984-4df2-8531-8dd8f4da4510,network=Network(17f39e27-bb24-456e-9bb4-6db6772309b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9178d4-39') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4253e987-4f03-52cc-a9a4-a2884f1b50a6', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd9178d4-39, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd9178d4-39, col_values=(('qos', UUID('1e2904d7-8972-4ef4-a53e-b821e1e1fbfc')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd9178d4-39, col_values=(('external_ids', {'iface-id': 'bd9178d4-3984-4df2-8531-8dd8f4da4510', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:75:c5', 'vm-uuid': '7b8c5beb-5551-48b0-8331-bfcba175cc0e'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:01 user nova-compute[75100]: INFO os_vif [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:75:c5,bridge_name='br-int',has_traffic_filtering=True,id=bd9178d4-3984-4df2-8531-8dd8f4da4510,network=Network(17f39e27-bb24-456e-9bb4-6db6772309b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9178d4-39')
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] No BDM found with device name sda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] No VIF found with MAC fa:16:3e:4b:75:c5, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:20:01 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Using config drive
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Updating instance_info_cache with network_info: [{"id": "a8348145-5a89-4365-ae02-deeb30863eae", "address": "fa:16:3e:ae:4f:f2", "network": {"id": "1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1383323174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633318b44b824f79a91e414700c3bc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8348145-5a", "ovs_interfaceid": "a8348145-5a89-4365-ae02-deeb30863eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Releasing lock "refresh_cache-55c68a33-6003-4b98-a248-f5d3dafe77f1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Instance network_info: |[{"id": "a8348145-5a89-4365-ae02-deeb30863eae", "address": "fa:16:3e:ae:4f:f2", "network": {"id": "1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1383323174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633318b44b824f79a91e414700c3bc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8348145-5a", "ovs_interfaceid": "a8348145-5a89-4365-ae02-deeb30863eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-50f856ad-344c-4663-9647-65db6ce6d6d4 req-da578fbe-dd1f-467c-ab12-4126f8cab140 service nova] Acquired lock "refresh_cache-55c68a33-6003-4b98-a248-f5d3dafe77f1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-50f856ad-344c-4663-9647-65db6ce6d6d4 req-da578fbe-dd1f-467c-ab12-4126f8cab140 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Refreshing network info cache for port a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Start _get_guest_xml network_info=[{"id": "a8348145-5a89-4365-ae02-deeb30863eae", "address": "fa:16:3e:ae:4f:f2", "network": {"id": "1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1383323174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633318b44b824f79a91e414700c3bc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8348145-5a", "ovs_interfaceid": "a8348145-5a89-4365-ae02-deeb30863eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:20:01 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:20:01 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1785488374',display_name='tempest-VolumesAssistedSnapshotsTest-server-1785488374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1785488374',id=9,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAWZULFtHhZTSVb1x81RT8YxhCD8hcoaUpiNDt1TIf6X/s8dX/ZGEaiUmNzoJAdZxp8TKq4JB8+bB3geWNrJLIBqtkAOLDXgmuOwwXkHWoOxCx0AwmTMpN7Z2NwxZpciQ==',key_name='tempest-keypair-1814116729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='633318b44b824f79a91e414700c3bc97',ramdisk_id='',reservation_id='r-a2y5010r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1084063573',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1084063573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5cc4868e77e468cae8b8fd0c29f2358',uuid=55c68a33-6003-4b98-a248-f5d3dafe77f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8348145-5a89-4365-ae02-deeb30863eae", "address": "fa:16:3e:ae:4f:f2", "network": {"id": "1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1383323174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633318b44b824f79a91e414700c3bc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8348145-5a", "ovs_interfaceid": "a8348145-5a89-4365-ae02-deeb30863eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Converting VIF {"id": "a8348145-5a89-4365-ae02-deeb30863eae", "address": "fa:16:3e:ae:4f:f2", "network": {"id": "1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1383323174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633318b44b824f79a91e414700c3bc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8348145-5a", "ovs_interfaceid": "a8348145-5a89-4365-ae02-deeb30863eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:f2,bridge_name='br-int',has_traffic_filtering=True,id=a8348145-5a89-4365-ae02-deeb30863eae,network=Network(1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8348145-5a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lazy-loading 'pci_devices' on Instance uuid 55c68a33-6003-4b98-a248-f5d3dafe77f1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Successfully created port: c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:20:01 user nova-compute[75100]:   <uuid>55c68a33-6003-4b98-a248-f5d3dafe77f1</uuid>
Nov 13 17:20:01 user nova-compute[75100]:   <name>instance-00000009</name>
Nov 13 17:20:01 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:20:01 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:20:01 user nova-compute[75100]:   <metadata>
Nov 13 17:20:01 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:20:01 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:20:01 user nova-compute[75100]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1785488374</nova:name>
Nov 13 17:20:01 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:20:01</nova:creationTime>
Nov 13 17:20:01 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:20:01 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:20:01 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:20:01 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:20:01 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:20:01 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:20:01 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:20:01 user nova-compute[75100]:       <nova:owner>
Nov 13 17:20:01 user nova-compute[75100]:         <nova:user uuid="f5cc4868e77e468cae8b8fd0c29f2358">tempest-VolumesAssistedSnapshotsTest-1084063573-project-member</nova:user>
Nov 13 17:20:01 user nova-compute[75100]:         <nova:project uuid="633318b44b824f79a91e414700c3bc97">tempest-VolumesAssistedSnapshotsTest-1084063573</nova:project>
Nov 13 17:20:01 user nova-compute[75100]:       </nova:owner>
Nov 13 17:20:01 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:20:01 user nova-compute[75100]:       <nova:ports>
Nov 13 17:20:01 user nova-compute[75100]:         <nova:port uuid="a8348145-5a89-4365-ae02-deeb30863eae">
Nov 13 17:20:01 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 17:20:01 user nova-compute[75100]:         </nova:port>
Nov 13 17:20:01 user nova-compute[75100]:       </nova:ports>
Nov 13 17:20:01 user nova-compute[75100]:     </nova:instance>
Nov 13 17:20:01 user nova-compute[75100]:   </metadata>
Nov 13 17:20:01 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:20:01 user nova-compute[75100]:     <system>
Nov 13 17:20:01 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:20:01 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:20:01 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:20:01 user nova-compute[75100]:       <entry name="serial">55c68a33-6003-4b98-a248-f5d3dafe77f1</entry>
Nov 13 17:20:01 user nova-compute[75100]:       <entry name="uuid">55c68a33-6003-4b98-a248-f5d3dafe77f1</entry>
Nov 13 17:20:01 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:20:01 user nova-compute[75100]:     </system>
Nov 13 17:20:01 user nova-compute[75100]:   </sysinfo>
Nov 13 17:20:01 user nova-compute[75100]:   <os>
Nov 13 17:20:01 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:20:01 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:20:01 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:20:01 user nova-compute[75100]:   </os>
Nov 13 17:20:01 user nova-compute[75100]:   <features>
Nov 13 17:20:01 user nova-compute[75100]:     <acpi/>
Nov 13 17:20:01 user nova-compute[75100]:     <apic/>
Nov 13 17:20:01 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:20:01 user nova-compute[75100]:   </features>
Nov 13 17:20:01 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:20:01 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:20:01 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:20:01 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:20:01 user nova-compute[75100]:   </clock>
Nov 13 17:20:01 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:20:01 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:20:01 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:20:01 user nova-compute[75100]:   </cpu>
Nov 13 17:20:01 user nova-compute[75100]:   <devices>
Nov 13 17:20:01 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:20:01 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:20:01 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk"/>
Nov 13 17:20:01 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:20:01 user nova-compute[75100]:     </disk>
Nov 13 17:20:01 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:20:01 user nova-compute[75100]:       <mac address="fa:16:3e:ae:4f:f2"/>
Nov 13 17:20:01 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:01 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:20:01 user nova-compute[75100]:       <target dev="tapa8348145-5a"/>
Nov 13 17:20:01 user nova-compute[75100]:     </interface>
Nov 13 17:20:01 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:20:01 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/console.log" append="off"/>
Nov 13 17:20:01 user nova-compute[75100]:     </serial>
Nov 13 17:20:01 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:20:01 user nova-compute[75100]:     <video>
Nov 13 17:20:01 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:01 user nova-compute[75100]:     </video>
Nov 13 17:20:01 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:20:01 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:20:01 user nova-compute[75100]:     </rng>
Nov 13 17:20:01 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:20:01 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:20:01 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:20:01 user nova-compute[75100]:     </memballoon>
Nov 13 17:20:01 user nova-compute[75100]:   </devices>
Nov 13 17:20:01 user nova-compute[75100]: </domain>
Nov 13 17:20:01 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1785488374',display_name='tempest-VolumesAssistedSnapshotsTest-server-1785488374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1785488374',id=9,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAWZULFtHhZTSVb1x81RT8YxhCD8hcoaUpiNDt1TIf6X/s8dX/ZGEaiUmNzoJAdZxp8TKq4JB8+bB3geWNrJLIBqtkAOLDXgmuOwwXkHWoOxCx0AwmTMpN7Z2NwxZpciQ==',key_name='tempest-keypair-1814116729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='633318b44b824f79a91e414700c3bc97',ramdisk_id='',reservation_id='r-a2y5010r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1084063573',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1084063573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5cc4868e77e468cae8b8fd0c29f2358',uuid=55c68a33-6003-4b98-a248-f5d3dafe77f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8348145-5a89-4365-ae02-deeb30863eae", "address": "fa:16:3e:ae:4f:f2", "network": {"id": "1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1383323174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633318b44b824f79a91e414700c3bc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8348145-5a", "ovs_interfaceid": "a8348145-5a89-4365-ae02-deeb30863eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Converting VIF {"id": "a8348145-5a89-4365-ae02-deeb30863eae", "address": "fa:16:3e:ae:4f:f2", "network": {"id": "1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1383323174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633318b44b824f79a91e414700c3bc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8348145-5a", "ovs_interfaceid": "a8348145-5a89-4365-ae02-deeb30863eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:f2,bridge_name='br-int',has_traffic_filtering=True,id=a8348145-5a89-4365-ae02-deeb30863eae,network=Network(1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8348145-5a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG os_vif [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:f2,bridge_name='br-int',has_traffic_filtering=True,id=a8348145-5a89-4365-ae02-deeb30863eae,network=Network(1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8348145-5a') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2fef4c55-5149-5458-9310-fac6f91bf9a8', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8348145-5a, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8348145-5a, col_values=(('qos', UUID('00869ad8-137c-4bf3-8fb5-1199f1ebccea')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8348145-5a, col_values=(('external_ids', {'iface-id': 'a8348145-5a89-4365-ae02-deeb30863eae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:4f:f2', 'vm-uuid': '55c68a33-6003-4b98-a248-f5d3dafe77f1'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:01 user nova-compute[75100]: INFO os_vif [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:4f:f2,bridge_name='br-int',has_traffic_filtering=True,id=a8348145-5a89-4365-ae02-deeb30863eae,network=Network(1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8348145-5a')
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] No VIF found with MAC fa:16:3e:ae:4f:f2, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:20:01 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Instance spawned successfully.
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-50f856ad-344c-4663-9647-65db6ce6d6d4 req-da578fbe-dd1f-467c-ab12-4126f8cab140 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Updated VIF entry in instance network info cache for port a8348145-5a89-4365-ae02-deeb30863eae. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-50f856ad-344c-4663-9647-65db6ce6d6d4 req-da578fbe-dd1f-467c-ab12-4126f8cab140 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Updating instance_info_cache with network_info: [{"id": "a8348145-5a89-4365-ae02-deeb30863eae", "address": "fa:16:3e:ae:4f:f2", "network": {"id": "1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1383323174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633318b44b824f79a91e414700c3bc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8348145-5a", "ovs_interfaceid": "a8348145-5a89-4365-ae02-deeb30863eae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-50f856ad-344c-4663-9647-65db6ce6d6d4 req-da578fbe-dd1f-467c-ab12-4126f8cab140 service nova] Releasing lock "refresh_cache-55c68a33-6003-4b98-a248-f5d3dafe77f1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:02 user nova-compute[75100]: INFO nova.compute.manager [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Took 9.22 seconds to spawn the instance on the hypervisor.
Nov 13 17:20:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-62158d62-4cd1-4e7e-bcac-5c4b83a617da req-b40b1a09-c4d3-445c-9e4e-df9a7aef4144 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Updated VIF entry in instance network info cache for port bd9178d4-3984-4df2-8531-8dd8f4da4510. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-62158d62-4cd1-4e7e-bcac-5c4b83a617da req-b40b1a09-c4d3-445c-9e4e-df9a7aef4144 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Updating instance_info_cache with network_info: [{"id": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "address": "fa:16:3e:4b:75:c5", "network": {"id": "17f39e27-bb24-456e-9bb4-6db6772309b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-944565688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078f6299ef104b968a06e3e9cd6dd5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9178d4-39", "ovs_interfaceid": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-62158d62-4cd1-4e7e-bcac-5c4b83a617da req-b40b1a09-c4d3-445c-9e4e-df9a7aef4144 service nova] Releasing lock "refresh_cache-7b8c5beb-5551-48b0-8331-bfcba175cc0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Creating config drive at /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk.config
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpf0q40ro8 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:02 user nova-compute[75100]: INFO nova.compute.manager [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Took 10.86 seconds to build instance.
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpf0q40ro8" returned: 0 in 0.095s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ceb5fce8-4956-49a9-86f7-82f089a447df tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.031s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:02 user sudo[85566]: pam_unix(sudo:session): session closed for user root
Nov 13 17:20:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Successfully updated port: c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:20:02 user nova-compute[75100]: INFO oslo.privsep.daemon [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Spawned new privsep daemon via rootwrap
Nov 13 17:20:02 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 17:20:02 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 17:20:02 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 13 17:20:02 user nova-compute[75100]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85770
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "refresh_cache-5ead8372-787b-41f8-95cc-11dd49093606" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquired lock "refresh_cache-5ead8372-787b-41f8-95cc-11dd49093606" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-0372c072-950b-490f-8d29-d75f5bc483b4 req-a9fb6d41-bff0-4d5d-8833-d8e7c9e7704a service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-changed-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-0372c072-950b-490f-8d29-d75f5bc483b4 req-a9fb6d41-bff0-4d5d-8833-d8e7c9e7704a service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Refreshing instance network info cache due to event network-changed-c364a290-68a0-4e5c-9865-a9b19620f0d1. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0372c072-950b-490f-8d29-d75f5bc483b4 req-a9fb6d41-bff0-4d5d-8833-d8e7c9e7704a service nova] Acquiring lock "refresh_cache-5ead8372-787b-41f8-95cc-11dd49093606" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c4c721-a3e6-4ff9-912a-29fb52304e35]: (2,) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6eeb155-da3f-494a-a1f4-af72c3f1edf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:02 user nova-compute[75100]: WARNING os_brick.initiator.connectors.nvmeof [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce962a3-3a99-4f51-ae8c-3ca3a28edb69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[286169b4-b75a-4299-b70c-b7367a8bad12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fafa0a4-a9cf-4bd3-9b48-374c82a07d3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8d97d015-0af3-4f3b-a3c4-2f52e1d4e2ae req-0dab7da4-12ab-42f8-aaae-91e63da890c0 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Received event network-vif-plugged-17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8d97d015-0af3-4f3b-a3c4-2f52e1d4e2ae req-0dab7da4-12ab-42f8-aaae-91e63da890c0 service nova] Acquiring lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8d97d015-0af3-4f3b-a3c4-2f52e1d4e2ae req-0dab7da4-12ab-42f8-aaae-91e63da890c0 service nova] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8d97d015-0af3-4f3b-a3c4-2f52e1d4e2ae req-0dab7da4-12ab-42f8-aaae-91e63da890c0 service nova] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8d97d015-0af3-4f3b-a3c4-2f52e1d4e2ae req-0dab7da4-12ab-42f8-aaae-91e63da890c0 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] No waiting events found dispatching network-vif-plugged-17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:03 user nova-compute[75100]: WARNING nova.compute.manager [req-8d97d015-0af3-4f3b-a3c4-2f52e1d4e2ae req-0dab7da4-12ab-42f8-aaae-91e63da890c0 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Received unexpected event network-vif-plugged-17b414e0-be01-45df-9ae4-0a9be2c8b4cd for instance with vm_state active and task_state None.
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:20:03 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a9ef2d-d5b3-46d6-ba9a-039d5239a319]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG os_brick.utils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] <== get_connector_properties: return (2597ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Updating existing volume attachment record: 170f3257-2788-4ba3-9eb4-1abcb144ac59 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG nova.network.neutron [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Updating instance_info_cache with network_info: [{"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Releasing lock "refresh_cache-5ead8372-787b-41f8-95cc-11dd49093606" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Instance network_info: |[{"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0372c072-950b-490f-8d29-d75f5bc483b4 req-a9fb6d41-bff0-4d5d-8833-d8e7c9e7704a service nova] Acquired lock "refresh_cache-5ead8372-787b-41f8-95cc-11dd49093606" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-0372c072-950b-490f-8d29-d75f5bc483b4 req-a9fb6d41-bff0-4d5d-8833-d8e7c9e7704a service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Refreshing network info cache for port c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:04 user nova-compute[75100]: DEBUG nova.network.neutron [req-0372c072-950b-490f-8d29-d75f5bc483b4 req-a9fb6d41-bff0-4d5d-8833-d8e7c9e7704a service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Updated VIF entry in instance network info cache for port c364a290-68a0-4e5c-9865-a9b19620f0d1. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:20:04 user nova-compute[75100]: DEBUG nova.network.neutron [req-0372c072-950b-490f-8d29-d75f5bc483b4 req-a9fb6d41-bff0-4d5d-8833-d8e7c9e7704a service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Updating instance_info_cache with network_info: [{"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0372c072-950b-490f-8d29-d75f5bc483b4 req-a9fb6d41-bff0-4d5d-8833-d8e7c9e7704a service nova] Releasing lock "refresh_cache-5ead8372-787b-41f8-95cc-11dd49093606" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Received event network-vif-plugged-17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] Acquiring lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] No waiting events found dispatching network-vif-plugged-17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:05 user nova-compute[75100]: WARNING nova.compute.manager [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Received unexpected event network-vif-plugged-17b414e0-be01-45df-9ae4-0a9be2c8b4cd for instance with vm_state active and task_state None.
Nov 13 17:20:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Received event network-vif-plugged-a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] Acquiring lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] No waiting events found dispatching network-vif-plugged-a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:05 user nova-compute[75100]: WARNING nova.compute.manager [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Received unexpected event network-vif-plugged-a8348145-5a89-4365-ae02-deeb30863eae for instance with vm_state building and task_state spawning.
Nov 13 17:20:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Received event network-vif-plugged-a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] Acquiring lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] No waiting events found dispatching network-vif-plugged-a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:05 user nova-compute[75100]: WARNING nova.compute.manager [req-26d6bbc4-1f86-45d1-8c0a-fedd9dabb80b req-72ddfac0-ea2c-4a01-bbc0-07c1527abf45 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Received unexpected event network-vif-plugged-a8348145-5a89-4365-ae02-deeb30863eae for instance with vm_state building and task_state spawning.
Nov 13 17:20:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:20:07 user nova-compute[75100]: INFO nova.compute.claims [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Claim successful on node user
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Instance spawned successfully.
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Instance spawned successfully.
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:20:07 user nova-compute[75100]: INFO nova.compute.manager [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Took 9.85 seconds to spawn the instance on the hypervisor.
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:07 user nova-compute[75100]: INFO nova.compute.manager [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Took 13.97 seconds to spawn the instance on the hypervisor.
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:20:07 user nova-compute[75100]: INFO nova.compute.manager [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Took 11.68 seconds to build instance.
Nov 13 17:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed2eea2-5ed4-4b59-8b40-8faa78ce23d4 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.988s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:20:07 user nova-compute[75100]: INFO nova.compute.manager [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Took 15.55 seconds to build instance.
Nov 13 17:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7671860c-840a-4827-9d88-7c9efe7b67bb tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.790s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:20:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:20:07 user nova-compute[75100]: DEBUG nova.policy [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '421484d1f180498fa5e078c084d70986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bd8fd1a36f49a08be3d97799e847a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:20:08 user nova-compute[75100]: INFO nova.virt.block_device [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Booting with volume snapshot ce852cc7-9635-4158-b379-767b89c44923 at /dev/vda
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:20:08 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Creating image(s)
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Ensure instance console log exists: /opt/stack/data/nova/instances/5ead8372-787b-41f8-95cc-11dd49093606/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Start _get_guest_xml network_info=[{"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '170f3257-2788-4ba3-9eb4-1abcb144ac59', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHOtjDqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ead8372-787b-41f8-95cc-11dd49093606', 'attached_at': '', 'detached_at': '', 'volume_id': 'c111e555-d452-4770-b8c7-853575a07b0b', 'serial': 'c111e555-d452-4770-b8c7-853575a07b0b'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:20:08 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:20:08 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connector [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Factory for ISCSI on None {{(pid=75100) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHOtjDqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:20:08 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:20:08 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:20:08 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e62f99-f231-4c0f-ae99-a4f997f55dc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:20:08 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.048s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d03a96-af79-43f9-8c77-fe88caa11b2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b] added
Nov 13 17:20:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70d36c5-7689-4185-9955-2dd5bdc31243]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aa6b3a-3565-473e-9be0-66c5495e05d5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHOtjDqT {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHOtjDqT" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[81adbcbe-86a3-497b-8188-52568c2f0362]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XHOtjDqT'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8489282d-2c8d-4b09-8d4f-c4dd40326186]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Successfully created port: 3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.039s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f070704f-704d-4ef9-82ae-3b29b0d598a7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:20:08 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:20:08 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:20:08 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 17:20:08 user nova-compute[75100]: 
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7edba67-aff4-4f6b-ac06-7d3ac20679fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260]
Nov 13 17:20:08 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260] successful.
Nov 13 17:20:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72a595c-a449-4bc2-8fb7-e6b7e98dfc35]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eeb26c-b7df-4975-be7b-902d020c6d8f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[828d736d-7dfe-46ec-8188-407e538466c4]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:20:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHOtjDqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:20:09 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Successfully updated port: 3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:20:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "refresh_cache-2d03f2e7-200c-4cd7-bc65-088c34eeb17d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquired lock "refresh_cache-2d03f2e7-200c-4cd7-bc65-088c34eeb17d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:09 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:20:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.451s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:20:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '26433626161323535', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:20:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433626161323535', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:20:09 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:20:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-716596890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-716596890',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMHrvy6dRXfrXCI4JiaUSDCttbmdw96JfvW+n8ZiGKpKZMjmLzpK9h3eR71xlPMzcT2ZyjL7UJxtt2DhdOyrObd8ECbbaG5NFmjMFIEU9X7Qc7cQ7GuxVyy0CTzRSvdWw==',key_name='tempest-keypair-203724816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec5af88d50944bbd9e6ec2ae84f194d2',ramdisk_id='',reservation_id='r-yqh7vk1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1979706355',owner_user_name='tempest-ServerActionsV293TestJSON-1979706355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f56979d0e374f6ea4be1920f5f62fd9',uuid=5ead8372-787b-41f8-95cc-11dd49093606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:20:09 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Converting VIF {"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:09 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:09 user nova-compute[75100]: DEBUG nova.objects.instance [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ead8372-787b-41f8-95cc-11dd49093606 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:20:10 user nova-compute[75100]:   <uuid>5ead8372-787b-41f8-95cc-11dd49093606</uuid>
Nov 13 17:20:10 user nova-compute[75100]:   <name>instance-0000000a</name>
Nov 13 17:20:10 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:20:10 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:20:10 user nova-compute[75100]:   <metadata>
Nov 13 17:20:10 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:20:10 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:20:10 user nova-compute[75100]:       <nova:name>tempest-ServerActionsV293TestJSON-server-716596890</nova:name>
Nov 13 17:20:10 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:20:08</nova:creationTime>
Nov 13 17:20:10 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:20:10 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:20:10 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:20:10 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:20:10 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:20:10 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:20:10 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:20:10 user nova-compute[75100]:       <nova:owner>
Nov 13 17:20:10 user nova-compute[75100]:         <nova:user uuid="4f56979d0e374f6ea4be1920f5f62fd9">tempest-ServerActionsV293TestJSON-1979706355-project-member</nova:user>
Nov 13 17:20:10 user nova-compute[75100]:         <nova:project uuid="ec5af88d50944bbd9e6ec2ae84f194d2">tempest-ServerActionsV293TestJSON-1979706355</nova:project>
Nov 13 17:20:10 user nova-compute[75100]:       </nova:owner>
Nov 13 17:20:10 user nova-compute[75100]:       <nova:ports>
Nov 13 17:20:10 user nova-compute[75100]:         <nova:port uuid="c364a290-68a0-4e5c-9865-a9b19620f0d1">
Nov 13 17:20:10 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 17:20:10 user nova-compute[75100]:         </nova:port>
Nov 13 17:20:10 user nova-compute[75100]:       </nova:ports>
Nov 13 17:20:10 user nova-compute[75100]:     </nova:instance>
Nov 13 17:20:10 user nova-compute[75100]:   </metadata>
Nov 13 17:20:10 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:20:10 user nova-compute[75100]:     <system>
Nov 13 17:20:10 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:20:10 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:20:10 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:20:10 user nova-compute[75100]:       <entry name="serial">5ead8372-787b-41f8-95cc-11dd49093606</entry>
Nov 13 17:20:10 user nova-compute[75100]:       <entry name="uuid">5ead8372-787b-41f8-95cc-11dd49093606</entry>
Nov 13 17:20:10 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:20:10 user nova-compute[75100]:     </system>
Nov 13 17:20:10 user nova-compute[75100]:   </sysinfo>
Nov 13 17:20:10 user nova-compute[75100]:   <os>
Nov 13 17:20:10 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:20:10 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:20:10 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:20:10 user nova-compute[75100]:   </os>
Nov 13 17:20:10 user nova-compute[75100]:   <features>
Nov 13 17:20:10 user nova-compute[75100]:     <acpi/>
Nov 13 17:20:10 user nova-compute[75100]:     <apic/>
Nov 13 17:20:10 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:20:10 user nova-compute[75100]:   </features>
Nov 13 17:20:10 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:20:10 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:20:10 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:20:10 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:20:10 user nova-compute[75100]:   </clock>
Nov 13 17:20:10 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:20:10 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:20:10 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:20:10 user nova-compute[75100]:   </cpu>
Nov 13 17:20:10 user nova-compute[75100]:   <devices>
Nov 13 17:20:10 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:20:10 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:20:10 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 13 17:20:10 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:20:10 user nova-compute[75100]:       <serial>c111e555-d452-4770-b8c7-853575a07b0b</serial>
Nov 13 17:20:10 user nova-compute[75100]:     </disk>
Nov 13 17:20:10 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:20:10 user nova-compute[75100]:       <mac address="fa:16:3e:dd:2b:2b"/>
Nov 13 17:20:10 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:10 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:20:10 user nova-compute[75100]:       <target dev="tapc364a290-68"/>
Nov 13 17:20:10 user nova-compute[75100]:     </interface>
Nov 13 17:20:10 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:20:10 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/5ead8372-787b-41f8-95cc-11dd49093606/console.log" append="off"/>
Nov 13 17:20:10 user nova-compute[75100]:     </serial>
Nov 13 17:20:10 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:20:10 user nova-compute[75100]:     <video>
Nov 13 17:20:10 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:10 user nova-compute[75100]:     </video>
Nov 13 17:20:10 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:20:10 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:20:10 user nova-compute[75100]:     </rng>
Nov 13 17:20:10 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:20:10 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:20:10 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:20:10 user nova-compute[75100]:     </memballoon>
Nov 13 17:20:10 user nova-compute[75100]:   </devices>
Nov 13 17:20:10 user nova-compute[75100]: </domain>
Nov 13 17:20:10 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-716596890',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-716596890',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMHrvy6dRXfrXCI4JiaUSDCttbmdw96JfvW+n8ZiGKpKZMjmLzpK9h3eR71xlPMzcT2ZyjL7UJxtt2DhdOyrObd8ECbbaG5NFmjMFIEU9X7Qc7cQ7GuxVyy0CTzRSvdWw==',key_name='tempest-keypair-203724816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec5af88d50944bbd9e6ec2ae84f194d2',ramdisk_id='',reservation_id='r-yqh7vk1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1979706355',owner_user_name='tempest-ServerActionsV293TestJSON-1979706355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f56979d0e374f6ea4be1920f5f62fd9',uuid=5ead8372-787b-41f8-95cc-11dd49093606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Converting VIF {"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG os_vif [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df67ad35-2932-535e-b98b-cec490f0d2e0', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc364a290-68, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc364a290-68, col_values=(('qos', UUID('0554aa76-ea69-4e58-9d8a-e713f2d50806')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc364a290-68, col_values=(('external_ids', {'iface-id': 'c364a290-68a0-4e5c-9865-a9b19620f0d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:2b:2b', 'vm-uuid': '5ead8372-787b-41f8-95cc-11dd49093606'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:10 user nova-compute[75100]: INFO os_vif [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68')
Nov 13 17:20:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-82210912-a9ce-4aae-80ae-43d1748787e4 req-edf934ae-ef6f-4344-9b67-0b8b4950c21a service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Received event network-changed-3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-82210912-a9ce-4aae-80ae-43d1748787e4 req-edf934ae-ef6f-4344-9b67-0b8b4950c21a service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Refreshing instance network info cache due to event network-changed-3d12ce3b-464f-4825-affd-2ea22cf6065a. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-82210912-a9ce-4aae-80ae-43d1748787e4 req-edf934ae-ef6f-4344-9b67-0b8b4950c21a service nova] Acquiring lock "refresh_cache-2d03f2e7-200c-4cd7-bc65-088c34eeb17d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] No VIF found with MAC fa:16:3e:dd:2b:2b, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG nova.network.neutron [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Updating instance_info_cache with network_info: [{"id": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "address": "fa:16:3e:5e:25:16", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d12ce3b-46", "ovs_interfaceid": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Releasing lock "refresh_cache-2d03f2e7-200c-4cd7-bc65-088c34eeb17d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Instance network_info: |[{"id": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "address": "fa:16:3e:5e:25:16", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d12ce3b-46", "ovs_interfaceid": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-82210912-a9ce-4aae-80ae-43d1748787e4 req-edf934ae-ef6f-4344-9b67-0b8b4950c21a service nova] Acquired lock "refresh_cache-2d03f2e7-200c-4cd7-bc65-088c34eeb17d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:10 user nova-compute[75100]: DEBUG nova.network.neutron [req-82210912-a9ce-4aae-80ae-43d1748787e4 req-edf934ae-ef6f-4344-9b67-0b8b4950c21a service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Refreshing network info cache for port 3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG nova.network.neutron [req-82210912-a9ce-4aae-80ae-43d1748787e4 req-edf934ae-ef6f-4344-9b67-0b8b4950c21a service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Updated VIF entry in instance network info cache for port 3d12ce3b-464f-4825-affd-2ea22cf6065a. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG nova.network.neutron [req-82210912-a9ce-4aae-80ae-43d1748787e4 req-edf934ae-ef6f-4344-9b67-0b8b4950c21a service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Updating instance_info_cache with network_info: [{"id": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "address": "fa:16:3e:5e:25:16", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d12ce3b-46", "ovs_interfaceid": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-82210912-a9ce-4aae-80ae-43d1748787e4 req-edf934ae-ef6f-4344-9b67-0b8b4950c21a service nova] Releasing lock "refresh_cache-2d03f2e7-200c-4cd7-bc65-088c34eeb17d" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e317197-717f-4712-9f08-28ad2d7c93a7 req-cccf8a99-bdaf-4974-b79e-67d1bfaccb7d service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e317197-717f-4712-9f08-28ad2d7c93a7 req-cccf8a99-bdaf-4974-b79e-67d1bfaccb7d service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e317197-717f-4712-9f08-28ad2d7c93a7 req-cccf8a99-bdaf-4974-b79e-67d1bfaccb7d service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e317197-717f-4712-9f08-28ad2d7c93a7 req-cccf8a99-bdaf-4974-b79e-67d1bfaccb7d service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e317197-717f-4712-9f08-28ad2d7c93a7 req-cccf8a99-bdaf-4974-b79e-67d1bfaccb7d service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] No waiting events found dispatching network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:12 user nova-compute[75100]: WARNING nova.compute.manager [req-6e317197-717f-4712-9f08-28ad2d7c93a7 req-cccf8a99-bdaf-4974-b79e-67d1bfaccb7d service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received unexpected event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 for instance with vm_state building and task_state spawning.
Nov 13 17:20:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:20:13 user nova-compute[75100]: DEBUG os_brick.utils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:20:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[405655e3-bb69-4c77-a680-6ea3ad92fe3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[447b3392-76cd-4b67-aae7-b790ddcd608d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee817b81-fb6a-42c9-b1f1-123da5558910]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eebcb8a-3691-4ddf-a90b-498555f34f3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:20:14 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eae01e-da25-43bb-af78-2fff7a48c74d]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG os_brick.utils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Updating existing volume attachment record: 4ce8348d-7fb2-4d6c-badc-ef9fe1419d42 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-6050d5f1-e815-4a5e-9efc-be84fbb9aa3a req-90c281f9-a9f8-4514-a7d1-e57f5a86472e service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6050d5f1-e815-4a5e-9efc-be84fbb9aa3a req-90c281f9-a9f8-4514-a7d1-e57f5a86472e service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6050d5f1-e815-4a5e-9efc-be84fbb9aa3a req-90c281f9-a9f8-4514-a7d1-e57f5a86472e service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6050d5f1-e815-4a5e-9efc-be84fbb9aa3a req-90c281f9-a9f8-4514-a7d1-e57f5a86472e service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-6050d5f1-e815-4a5e-9efc-be84fbb9aa3a req-90c281f9-a9f8-4514-a7d1-e57f5a86472e service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] No waiting events found dispatching network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:14 user nova-compute[75100]: WARNING nova.compute.manager [req-6050d5f1-e815-4a5e-9efc-be84fbb9aa3a req-90c281f9-a9f8-4514-a7d1-e57f5a86472e service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received unexpected event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 for instance with vm_state building and task_state spawning.
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:20:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Instance spawned successfully.
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:20:14 user nova-compute[75100]: INFO nova.compute.manager [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:20:14 user nova-compute[75100]: INFO nova.compute.manager [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Took 15.59 seconds to build instance.
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-52c0d5f3-e743-4027-8b2d-da5f9493ac3d tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "5ead8372-787b-41f8-95cc-11dd49093606" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.798s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:20:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:20:15 user nova-compute[75100]: INFO nova.compute.claims [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Claim successful on node user
Nov 13 17:20:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:20:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:20:15 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:20:15 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:20:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:20:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:20:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:20:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:20:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:20:16 user nova-compute[75100]: INFO nova.virt.block_device [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Booting with volume 2ddab20d-ea6e-468d-be6d-6c9a28b3141d at /dev/vda
Nov 13 17:20:16 user nova-compute[75100]: DEBUG os_brick.utils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-36bb50b7-f434-4169-af92-93d4a1178a7c req-497a7ada-c9a0-4d2e-90c5-fe74bc431189 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Received event network-vif-plugged-15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-36bb50b7-f434-4169-af92-93d4a1178a7c req-497a7ada-c9a0-4d2e-90c5-fe74bc431189 service nova] Acquiring lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-36bb50b7-f434-4169-af92-93d4a1178a7c req-497a7ada-c9a0-4d2e-90c5-fe74bc431189 service nova] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-36bb50b7-f434-4169-af92-93d4a1178a7c req-497a7ada-c9a0-4d2e-90c5-fe74bc431189 service nova] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-36bb50b7-f434-4169-af92-93d4a1178a7c req-497a7ada-c9a0-4d2e-90c5-fe74bc431189 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] No waiting events found dispatching network-vif-plugged-15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:16 user nova-compute[75100]: WARNING nova.compute.manager [req-36bb50b7-f434-4169-af92-93d4a1178a7c req-497a7ada-c9a0-4d2e-90c5-fe74bc431189 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Received unexpected event network-vif-plugged-15335f7b-d811-486f-a5ce-3643fa79fbc7 for instance with vm_state active and task_state None.
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6676cc98-cf09-4004-942a-a9f9a8ef1b6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a218d5-33a8-4595-af89-5301604c711d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead4ca4f-c18d-4884-b1d9-2393d6a253e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b932955-dde6-463e-90d9-73cf477fbe21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG nova.policy [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f05b94b0123546e3bd9324f9806edbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04e7fe01efa34fc489341a2429a5c754', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:20:16 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e4a81-8042-48c0-a54f-f4dfc26f8f85]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG os_brick.utils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating existing volume attachment record: 71673374-e8ac-49b1-a67e-fd8ba7c54c5e {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Skipping network cache update for instance because it is Building. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Skipping network cache update for instance because it is Building. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-31779592-a9f2-4aae-a658-e055ec832b37" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-31779592-a9f2-4aae-a658-e055ec832b37" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:20:16 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 31779592-a9f2-4aae-a658-e055ec832b37 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:20:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Updating instance_info_cache with network_info: [{"id": "b88af3f7-eb48-47b2-84c0-b991584a6826", "address": "fa:16:3e:9d:22:c1", "network": {"id": "7593ddf6-1ad8-4498-9cbd-3ad9b77db488", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1497148107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e9dffd99824724a921a72499143852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88af3f7-eb", "ovs_interfaceid": "b88af3f7-eb48-47b2-84c0-b991584a6826", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-31779592-a9f2-4aae-a658-e055ec832b37" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:20:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Successfully created port: 8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-f6d0769a-c35b-4db0-9827-b7c9dff85a31 req-abcc80d1-607f-4c11-abf2-873be4221854 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Received event network-vif-plugged-15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6d0769a-c35b-4db0-9827-b7c9dff85a31 req-abcc80d1-607f-4c11-abf2-873be4221854 service nova] Acquiring lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6d0769a-c35b-4db0-9827-b7c9dff85a31 req-abcc80d1-607f-4c11-abf2-873be4221854 service nova] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6d0769a-c35b-4db0-9827-b7c9dff85a31 req-abcc80d1-607f-4c11-abf2-873be4221854 service nova] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-f6d0769a-c35b-4db0-9827-b7c9dff85a31 req-abcc80d1-607f-4c11-abf2-873be4221854 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] No waiting events found dispatching network-vif-plugged-15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:18 user nova-compute[75100]: WARNING nova.compute.manager [req-f6d0769a-c35b-4db0-9827-b7c9dff85a31 req-abcc80d1-607f-4c11-abf2-873be4221854 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Received unexpected event network-vif-plugged-15335f7b-d811-486f-a5ce-3643fa79fbc7 for instance with vm_state active and task_state None.
Nov 13 17:20:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Successfully created port: c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:20:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Creating image(s)
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Ensure instance console log exists: /opt/stack/data/nova/instances/2d03f2e7-200c-4cd7-bc65-088c34eeb17d/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Start _get_guest_xml network_info=[{"id": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "address": "fa:16:3e:5e:25:16", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d12ce3b-46", "ovs_interfaceid": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '4ce8348d-7fb2-4d6c-badc-ef9fe1419d42', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDnOPhEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2d03f2e7-200c-4cd7-bc65-088c34eeb17d', 'attached_at': '', 'detached_at': '', 'volume_id': 'd400dc09-e63b-404a-9c6f-4fc1eddb990b', 'serial': 'd400dc09-e63b-404a-9c6f-4fc1eddb990b'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Successfully created port: b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:19 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:20:19 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:20:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDnOPhEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:20:19 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:20:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:20:19 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:20:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:20:19 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:20:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e05baa-5a6d-4de7-9768-d2f6cfbf2272]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:20:20 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de4a9d9-eba1-45ea-b127-1e57149c928c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b] added
Nov 13 17:20:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35c0809-7ffe-499b-9aa6-11093a440715]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c58f53-9391-4ffa-9947-b5a929c48386]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDnOPhEr {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDnOPhEr" returned: 0 in 0.043s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c843b640-7070-4a1b-a903-cdd00b57aa28]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LDnOPhEr'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.068s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[112db4e6-30f6-42d0-b38b-be407c7ec2a6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77703c4-d2f9-4e31-9638-412f5271eed3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a778c9f-2e28-470a-b695-df0a33f1c1ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b, portal: 172.16.0.220,3260]
Nov 13 17:20:20 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b, portal: 172.16.0.220,3260] successful.
Nov 13 17:20:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[63984a84-3f4f-4f92-a2e0-17634907cb26]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38ddd4e-b12c-48b7-acd1-90c4de0ccb52]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:20 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:20 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.528s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[778d76d8-30b0-4571-80af-d1de11412361]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDnOPhEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Successfully created port: f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:20:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.592s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== connect_volume: return (1598ms) {'type': 'block', 'scsi_wwn': '23361613432373937', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361613432373937', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-509358659',display_name='tempest-TestVolumeBootPattern-server-509358659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-509358659',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-f0jp3mpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:08Z,user_data=None,user_id='421484d1f180498fa5e078c084d70986',uuid=2d03f2e7-200c-4cd7-bc65-088c34eeb17d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "address": "fa:16:3e:5e:25:16", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d12ce3b-46", "ovs_interfaceid": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "address": "fa:16:3e:5e:25:16", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d12ce3b-46", "ovs_interfaceid": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:25:16,bridge_name='br-int',has_traffic_filtering=True,id=3d12ce3b-464f-4825-affd-2ea22cf6065a,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d12ce3b-46') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d03f2e7-200c-4cd7-bc65-088c34eeb17d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Successfully created port: e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:20:21 user nova-compute[75100]:   <uuid>2d03f2e7-200c-4cd7-bc65-088c34eeb17d</uuid>
Nov 13 17:20:21 user nova-compute[75100]:   <name>instance-0000000b</name>
Nov 13 17:20:21 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:20:21 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:20:21 user nova-compute[75100]:   <metadata>
Nov 13 17:20:21 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:20:21 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:20:21 user nova-compute[75100]:       <nova:name>tempest-TestVolumeBootPattern-server-509358659</nova:name>
Nov 13 17:20:21 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:20:19</nova:creationTime>
Nov 13 17:20:21 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:20:21 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:20:21 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:20:21 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:20:21 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:20:21 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:20:21 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:20:21 user nova-compute[75100]:       <nova:owner>
Nov 13 17:20:21 user nova-compute[75100]:         <nova:user uuid="421484d1f180498fa5e078c084d70986">tempest-TestVolumeBootPattern-1156978750-project-member</nova:user>
Nov 13 17:20:21 user nova-compute[75100]:         <nova:project uuid="20bd8fd1a36f49a08be3d97799e847a8">tempest-TestVolumeBootPattern-1156978750</nova:project>
Nov 13 17:20:21 user nova-compute[75100]:       </nova:owner>
Nov 13 17:20:21 user nova-compute[75100]:       <nova:ports>
Nov 13 17:20:21 user nova-compute[75100]:         <nova:port uuid="3d12ce3b-464f-4825-affd-2ea22cf6065a">
Nov 13 17:20:21 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 17:20:21 user nova-compute[75100]:         </nova:port>
Nov 13 17:20:21 user nova-compute[75100]:       </nova:ports>
Nov 13 17:20:21 user nova-compute[75100]:     </nova:instance>
Nov 13 17:20:21 user nova-compute[75100]:   </metadata>
Nov 13 17:20:21 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:20:21 user nova-compute[75100]:     <system>
Nov 13 17:20:21 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:20:21 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:20:21 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:20:21 user nova-compute[75100]:       <entry name="serial">2d03f2e7-200c-4cd7-bc65-088c34eeb17d</entry>
Nov 13 17:20:21 user nova-compute[75100]:       <entry name="uuid">2d03f2e7-200c-4cd7-bc65-088c34eeb17d</entry>
Nov 13 17:20:21 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:20:21 user nova-compute[75100]:     </system>
Nov 13 17:20:21 user nova-compute[75100]:   </sysinfo>
Nov 13 17:20:21 user nova-compute[75100]:   <os>
Nov 13 17:20:21 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:20:21 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:20:21 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:20:21 user nova-compute[75100]:   </os>
Nov 13 17:20:21 user nova-compute[75100]:   <features>
Nov 13 17:20:21 user nova-compute[75100]:     <acpi/>
Nov 13 17:20:21 user nova-compute[75100]:     <apic/>
Nov 13 17:20:21 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:20:21 user nova-compute[75100]:   </features>
Nov 13 17:20:21 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:20:21 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:20:21 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:20:21 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:20:21 user nova-compute[75100]:   </clock>
Nov 13 17:20:21 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:20:21 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:20:21 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:20:21 user nova-compute[75100]:   </cpu>
Nov 13 17:20:21 user nova-compute[75100]:   <devices>
Nov 13 17:20:21 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:20:21 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:20:21 user nova-compute[75100]:       <source dev="/dev/sdc"/>
Nov 13 17:20:21 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:20:21 user nova-compute[75100]:       <serial>d400dc09-e63b-404a-9c6f-4fc1eddb990b</serial>
Nov 13 17:20:21 user nova-compute[75100]:     </disk>
Nov 13 17:20:21 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:20:21 user nova-compute[75100]:       <mac address="fa:16:3e:5e:25:16"/>
Nov 13 17:20:21 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:21 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:20:21 user nova-compute[75100]:       <target dev="tap3d12ce3b-46"/>
Nov 13 17:20:21 user nova-compute[75100]:     </interface>
Nov 13 17:20:21 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:20:21 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/2d03f2e7-200c-4cd7-bc65-088c34eeb17d/console.log" append="off"/>
Nov 13 17:20:21 user nova-compute[75100]:     </serial>
Nov 13 17:20:21 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:20:21 user nova-compute[75100]:     <video>
Nov 13 17:20:21 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:21 user nova-compute[75100]:     </video>
Nov 13 17:20:21 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:20:21 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:20:21 user nova-compute[75100]:     </rng>
Nov 13 17:20:21 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:20:21 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:20:21 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:20:21 user nova-compute[75100]:     </memballoon>
Nov 13 17:20:21 user nova-compute[75100]:   </devices>
Nov 13 17:20:21 user nova-compute[75100]: </domain>
Nov 13 17:20:21 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-509358659',display_name='tempest-TestVolumeBootPattern-server-509358659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-509358659',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-f0jp3mpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:08Z,user_data=None,user_id='421484d1f180498fa5e078c084d70986',uuid=2d03f2e7-200c-4cd7-bc65-088c34eeb17d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "address": "fa:16:3e:5e:25:16", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d12ce3b-46", "ovs_interfaceid": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "address": "fa:16:3e:5e:25:16", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d12ce3b-46", "ovs_interfaceid": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:25:16,bridge_name='br-int',has_traffic_filtering=True,id=3d12ce3b-464f-4825-affd-2ea22cf6065a,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d12ce3b-46') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG os_vif [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:25:16,bridge_name='br-int',has_traffic_filtering=True,id=3d12ce3b-464f-4825-affd-2ea22cf6065a,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d12ce3b-46') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f829448d-fc4c-5b74-96a6-6dae03b8231b', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d12ce3b-46, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d12ce3b-46, col_values=(('qos', UUID('1c1f06f9-245d-45ff-8fc0-b38a6e7a11dc')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d12ce3b-46, col_values=(('external_ids', {'iface-id': '3d12ce3b-464f-4825-affd-2ea22cf6065a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:25:16', 'vm-uuid': '2d03f2e7-200c-4cd7-bc65-088c34eeb17d'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:21 user nova-compute[75100]: INFO os_vif [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:25:16,bridge_name='br-int',has_traffic_filtering=True,id=3d12ce3b-464f-4825-affd-2ea22cf6065a,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d12ce3b-46')
Nov 13 17:20:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:20:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] No VIF found with MAC fa:16:3e:5e:25:16, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:20:21 user nova-compute[75100]: INFO nova.virt.block_device [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Booting with volume bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 at /dev/vdb
Nov 13 17:20:22 user nova-compute[75100]: DEBUG os_brick.utils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ddfe61-4afe-42db-b257-1f376c641a61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[036f23e2-2416-460b-bdc0-b2632a1f2dcc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e3b510-a444-4433-927c-dec1fd2c00cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e93eb0-bf24-466a-be96-deed61451b2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:20:22 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[242a4117-93b3-4776-8483-0b0479e3e387]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG os_brick.utils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating existing volume attachment record: acc50e23-32be-4d4f-a9cf-8ad54967e050 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Successfully updated port: 8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-8b570faf-82ea-4a50-903b-574e2311f16e req-89cc431d-fe1c-4a19-8290-ff35f6a33a5f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-changed-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-8b570faf-82ea-4a50-903b-574e2311f16e req-89cc431d-fe1c-4a19-8290-ff35f6a33a5f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing instance network info cache due to event network-changed-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8b570faf-82ea-4a50-903b-574e2311f16e req-89cc431d-fe1c-4a19-8290-ff35f6a33a5f service nova] Acquiring lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8b570faf-82ea-4a50-903b-574e2311f16e req-89cc431d-fe1c-4a19-8290-ff35f6a33a5f service nova] Acquired lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-8b570faf-82ea-4a50-903b-574e2311f16e req-89cc431d-fe1c-4a19-8290-ff35f6a33a5f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing network info cache for port 8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-8b570faf-82ea-4a50-903b-574e2311f16e req-89cc431d-fe1c-4a19-8290-ff35f6a33a5f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Successfully updated port: a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.network.neutron [req-8b570faf-82ea-4a50-903b-574e2311f16e req-89cc431d-fe1c-4a19-8290-ff35f6a33a5f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-changed-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing instance network info cache due to event network-changed-a020143e-a824-46fb-8988-9de41419b4cc. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Acquiring lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8b570faf-82ea-4a50-903b-574e2311f16e req-89cc431d-fe1c-4a19-8290-ff35f6a33a5f service nova] Releasing lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Acquired lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.network.neutron [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing network info cache for port a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:20:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:20:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7284MB free_disk=25.537826538085938GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Instance spawned successfully.
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.network.neutron [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:20:26 user nova-compute[75100]: INFO nova.compute.manager [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:20:26 user nova-compute[75100]: INFO nova.compute.manager [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Took 19.36 seconds to build instance.
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e4b1a923-4d73-4b8e-a5f6-f0090d0c18d1 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.466s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.network.neutron [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 31779592-a9f2-4aae-a658-e055ec832b37 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 64c9f78b-8ce5-4328-9fb0-93715df6135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7b8c5beb-5551-48b0-8331-bfcba175cc0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 55c68a33-6003-4b98-a248-f5d3dafe77f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 5ead8372-787b-41f8-95cc-11dd49093606 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 2d03f2e7-200c-4cd7-bc65-088c34eeb17d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Releasing lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Received event network-vif-plugged-bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Acquiring lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] No waiting events found dispatching network-vif-plugged-bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:26 user nova-compute[75100]: WARNING nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Received unexpected event network-vif-plugged-bd9178d4-3984-4df2-8531-8dd8f4da4510 for instance with vm_state active and task_state None.
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Received event network-vif-plugged-bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Acquiring lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] No waiting events found dispatching network-vif-plugged-bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:26 user nova-compute[75100]: WARNING nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Received unexpected event network-vif-plugged-bd9178d4-3984-4df2-8531-8dd8f4da4510 for instance with vm_state active and task_state None.
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Received event network-vif-plugged-3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Acquiring lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] No waiting events found dispatching network-vif-plugged-3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:26 user nova-compute[75100]: WARNING nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Received unexpected event network-vif-plugged-3d12ce3b-464f-4825-affd-2ea22cf6065a for instance with vm_state building and task_state spawning.
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Received event network-vif-plugged-3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Acquiring lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] No waiting events found dispatching network-vif-plugged-3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:26 user nova-compute[75100]: WARNING nova.compute.manager [req-7d77451c-4a4c-43dd-9113-4a66a608f229 req-b87535bf-6e35-4c45-a3d6-570683911e3d service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Received unexpected event network-vif-plugged-3d12ce3b-464f-4825-affd-2ea22cf6065a for instance with vm_state building and task_state spawning.
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing inventories for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating ProviderTree inventory for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating inventory in ProviderTree for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing aggregate associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 17:20:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing trait associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 17:20:27 user nova-compute[75100]: INFO nova.virt.block_device [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Booting with volume b32f771b-b2ae-43cc-8578-753ba1081163 at /dev/vdc
Nov 13 17:20:27 user nova-compute[75100]: DEBUG os_brick.utils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a373ba7-aeaa-4b0b-afaf-c1b125cf6f97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8b961e-6831-4bc8-aef1-7e5ffe8c7c67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Successfully updated port: 6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[09452546-a6c7-40dc-8717-05c323a2959a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f482b1-e409-4bd1-a400-0c66e1feb3dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-7341ad4f-f47d-47c1-8ded-904ff8748951 req-36ef63c6-9612-42a1-8391-1126cf47e3b5 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-changed-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-7341ad4f-f47d-47c1-8ded-904ff8748951 req-36ef63c6-9612-42a1-8391-1126cf47e3b5 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing instance network info cache due to event network-changed-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7341ad4f-f47d-47c1-8ded-904ff8748951 req-36ef63c6-9612-42a1-8391-1126cf47e3b5 service nova] Acquiring lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7341ad4f-f47d-47c1-8ded-904ff8748951 req-36ef63c6-9612-42a1-8391-1126cf47e3b5 service nova] Acquired lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG nova.network.neutron [req-7341ad4f-f47d-47c1-8ded-904ff8748951 req-36ef63c6-9612-42a1-8391-1126cf47e3b5 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing network info cache for port 6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:20:27 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e37058-d3eb-484e-9cae-0f77ce529a08]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG os_brick.utils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating existing volume attachment record: a84bf4ba-1cac-456e-849f-377482d31d48 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.309s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG nova.network.neutron [req-7341ad4f-f47d-47c1-8ded-904ff8748951 req-36ef63c6-9612-42a1-8391-1126cf47e3b5 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG nova.network.neutron [req-7341ad4f-f47d-47c1-8ded-904ff8748951 req-36ef63c6-9612-42a1-8391-1126cf47e3b5 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7341ad4f-f47d-47c1-8ded-904ff8748951 req-36ef63c6-9612-42a1-8391-1126cf47e3b5 service nova] Releasing lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Successfully updated port: c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:20:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:20:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Successfully updated port: b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-changed-c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing instance network info cache due to event network-changed-c69ece98-a175-4524-b5b6-acf4d6804db7. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] Acquiring lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] Acquired lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing network info cache for port c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] Releasing lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-changed-b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing instance network info cache due to event network-changed-b401007f-7e49-4a6e-9ac9-1da782cfea31. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] Acquiring lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] Acquired lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing network info cache for port b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Successfully updated port: f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:20:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:20:30 user nova-compute[75100]: DEBUG nova.network.neutron [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a2292f0-e17a-48ff-9d77-a678e5ead50a req-3d299c45-6356-4651-a1ed-4870802b094c service nova] Releasing lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Successfully updated port: e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:20:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquired lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:20:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:20:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-changed-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing instance network info cache due to event network-changed-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:20:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] Acquiring lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:20:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Creating image(s)
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Ensure instance console log exists: /opt/stack/data/nova/instances/f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [{"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "address": "fa:16:3e:71:c2:19", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8660440-37", "ovs_interfaceid": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Releasing lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Instance network_info: |[{"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "address": "fa:16:3e:71:c2:19", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8660440-37", "ovs_interfaceid": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] Acquired lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing network info cache for port f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Start _get_guest_xml network_info=[{"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "address": "fa:16:3e:71:c2:19", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8660440-37", "ovs_interfaceid": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '71673374-e8ac-49b1-a67e-fd8ba7c54c5e', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxbgTPrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e', 'attached_at': '', 'detached_at': '', 'volume_id': '2ddab20d-ea6e-468d-be6d-6c9a28b3141d', 'serial': '2ddab20d-ea6e-468d-be6d-6c9a28b3141d'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'acc50e23-32be-4d4f-a9cf-8ad54967e050', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFBHPDNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78', 'serial': 'bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78'}, 'device_type': 'disk', 'boot_index': 1, 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': 'a84bf4ba-1cac-456e-849f-377482d31d48', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdqvuVPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b32f771b-b2ae-43cc-8578-753ba1081163', 'serial': 'b32f771b-b2ae-43cc-8578-753ba1081163'}, 'device_type': 'disk', 'boot_index': 2, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:20:32 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:20:32 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxbgTPrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:20:32 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:20:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:20:32 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:20:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:20:32 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c55a4e9-350d-46e8-adc1-3427bf1c6d7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:20:32 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a51151b-5de3-489b-9a55-0f9068a3092c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d] added
Nov 13 17:20:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adfef6c-3483-4d37-b769-ae984ad8b4bd]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1931ffa1-eaa4-4232-8fb8-250538b26274]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxbgTPrQ {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LxbgTPrQ" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c44a2f-6f5d-41ba-aea5-178c311cf8dc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LxbgTPrQ'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0daa41f-4c8a-46bc-9aa2-303d9f1113d1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a4bba8-ffd5-4da6-93f1-16c92b76d3fc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:33 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:33 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[19be3f72-bfe0-400a-8495-22b0b076f190]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d, portal: 172.16.0.220,3260]
Nov 13 17:20:33 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d, portal: 172.16.0.220,3260] successful.
Nov 13 17:20:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[801de51c-26e6-4dd6-aa8f-dad2837dee34]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc15829e-b0b8-49b1-bae1-27cd7ada244c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:33 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:33 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:20:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:33 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:33 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:20:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f46e6f-cf26-4a5d-8ae3-aefe89a9b1de]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxbgTPrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updated VIF entry in instance network info cache for port f74a46ed-40fb-40ab-ad63-74b69ab3a6ef. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [{"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "address": "fa:16:3e:71:c2:19", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8660440-37", "ovs_interfaceid": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] Releasing lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-changed-e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing instance network info cache due to event network-changed-e8660440-37a5-4e0e-a0cd-99ab02aaa577. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] Acquiring lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] Acquired lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing network info cache for port e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updated VIF entry in instance network info cache for port e8660440-37a5-4e0e-a0cd-99ab02aaa577. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [{"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "address": "fa:16:3e:71:c2:19", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8660440-37", "ovs_interfaceid": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:20:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f391c9d8-df60-44ae-a41c-cb39352d6b1e req-79043a80-59a4-44c1-90df-be1849868230 service nova] Releasing lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23564393431353230', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564393431353230', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFBHPDNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:20:34 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:20:34 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:20:34 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cb7ef8-b36d-4bf5-9df6-12359408d500]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:20:34 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5540430e-11d8-4488-8f28-f71a17adbb6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78] added
Nov 13 17:20:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcda28e-6bbb-47f0-878c-88355490021f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[43067c23-a131-4fdf-8b66-298b6f2548ea]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFBHPDNE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFBHPDNE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99bd4eb-61af-497f-9ea0-f9599d22c0c8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OFBHPDNE'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b82414-aa59-45be-9e3f-bf0271450364]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[850c0e11-d6de-4fac-bcd9-8679737ee6cc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:34 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:34 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:20:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:34 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:34 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:20:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb34ce0-0c19-4747-aa0c-c34eca5d4b18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78, portal: 172.16.0.220,3260]
Nov 13 17:20:34 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78, portal: 172.16.0.220,3260] successful.
Nov 13 17:20:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb648f0d-0ae6-4eb0-8209-91c579530122]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[386ce477-47ec-422d-8802-de9191a3129b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:34 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:34 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:20:34 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:20:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:34 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:34 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:20:34 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:20:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7da07c1-3c80-4cc6-b892-7f2ae5f82659]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:20:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFBHPDNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23363396638623861', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363396638623861', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdqvuVPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:20:35 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:20:35 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:20:35 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eceaad83-29fb-4139-bb61-59f17c01782a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:20:35 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeec6f9-0e11-42e9-b0bf-ab1be76e7dc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163] added
Nov 13 17:20:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbba043c-f245-401f-97dc-47b74779379a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef05edce-b2e6-4bc5-9742-3cd89913d43d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YdqvuVPT {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YdqvuVPT" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d12351b-5755-40a8-8c0c-1bc0850797c7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YdqvuVPT'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6378b8ea-ebba-4158-bf39-0172552270ca]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b0a861-8909-45c6-8881-81d34d2257ff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:20:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:20:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --login" returned: 0 in 0.145s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b935b20-af28-49f3-8c61-94cd3533278f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163, portal: 172.16.0.220,3260]
Nov 13 17:20:35 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163, portal: 172.16.0.220,3260] successful.
Nov 13 17:20:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11ce7df-3a58-4032-bb8b-8d79e5a9a870]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cf369e-6deb-4e68-a6ad-f809c354dcdc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:20:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:20:35 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:20:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a881467-b615-4cdb-998d-c19ab6931d06]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:20:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:20:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:36 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:20:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdqvuVPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:20:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:20:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23563373437356435', 'path': '/dev/sdf'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:20:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563373437356435', 'path': '/dev/sdf'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:bc:c8,bridge_name='br-int',has_traffic_filtering=True,id=8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340,network=Network(5bf875da-58d1-4ba4-8e2a-6cca9e5199ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9c51ce-9d') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=a020143e-a824-46fb-8988-9de41419b4cc,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa020143e-a8') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f2:c7,bridge_name='br-int',has_traffic_filtering=True,id=6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c1300f5-b3') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:dd:6b,bridge_name='br-int',has_traffic_filtering=True,id=c69ece98-a175-4524-b5b6-acf4d6804db7,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69ece98-a1') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6b:dc,bridge_name='br-int',has_traffic_filtering=True,id=b401007f-7e49-4a6e-9ac9-1da782cfea31,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb401007f-7e') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=f74a46ed-40fb-40ab-ad63-74b69ab3a6ef,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74a46ed-40') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "address": "fa:16:3e:71:c2:19", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8660440-37", "ovs_interfaceid": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "address": "fa:16:3e:71:c2:19", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8660440-37", "ovs_interfaceid": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c2:19,bridge_name='br-int',has_traffic_filtering=True,id=e8660440-37a5-4e0e-a0cd-99ab02aaa577,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8660440-37') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lazy-loading 'pci_devices' on Instance uuid f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:20:37 user nova-compute[75100]:   <uuid>f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e</uuid>
Nov 13 17:20:37 user nova-compute[75100]:   <name>instance-0000000c</name>
Nov 13 17:20:37 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:20:37 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:20:37 user nova-compute[75100]:   <metadata>
Nov 13 17:20:37 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:20:37 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:20:37 user nova-compute[75100]:       <nova:name>tempest-device-tagging-server-166150551</nova:name>
Nov 13 17:20:37 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:20:32</nova:creationTime>
Nov 13 17:20:37 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:20:37 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:20:37 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:20:37 user nova-compute[75100]:       <nova:owner>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:user uuid="f05b94b0123546e3bd9324f9806edbca">tempest-TaggedBootDevicesTest-921800196-project-member</nova:user>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:project uuid="04e7fe01efa34fc489341a2429a5c754">tempest-TaggedBootDevicesTest-921800196</nova:project>
Nov 13 17:20:37 user nova-compute[75100]:       </nova:owner>
Nov 13 17:20:37 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:20:37 user nova-compute[75100]:       <nova:ports>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:port uuid="8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340">
Nov 13 17:20:37 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 17:20:37 user nova-compute[75100]:         </nova:port>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:port uuid="a020143e-a824-46fb-8988-9de41419b4cc">
Nov 13 17:20:37 user nova-compute[75100]:           <nova:ip type="fixed" address="10.1.1.89" ipVersion="4"/>
Nov 13 17:20:37 user nova-compute[75100]:         </nova:port>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:port uuid="6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a">
Nov 13 17:20:37 user nova-compute[75100]:           <nova:ip type="fixed" address="10.1.1.248" ipVersion="4"/>
Nov 13 17:20:37 user nova-compute[75100]:         </nova:port>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:port uuid="c69ece98-a175-4524-b5b6-acf4d6804db7">
Nov 13 17:20:37 user nova-compute[75100]:           <nova:ip type="fixed" address="10.1.1.194" ipVersion="4"/>
Nov 13 17:20:37 user nova-compute[75100]:         </nova:port>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:port uuid="b401007f-7e49-4a6e-9ac9-1da782cfea31">
Nov 13 17:20:37 user nova-compute[75100]:           <nova:ip type="fixed" address="10.1.1.211" ipVersion="4"/>
Nov 13 17:20:37 user nova-compute[75100]:         </nova:port>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:port uuid="f74a46ed-40fb-40ab-ad63-74b69ab3a6ef">
Nov 13 17:20:37 user nova-compute[75100]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 13 17:20:37 user nova-compute[75100]:         </nova:port>
Nov 13 17:20:37 user nova-compute[75100]:         <nova:port uuid="e8660440-37a5-4e0e-a0cd-99ab02aaa577">
Nov 13 17:20:37 user nova-compute[75100]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 13 17:20:37 user nova-compute[75100]:         </nova:port>
Nov 13 17:20:37 user nova-compute[75100]:       </nova:ports>
Nov 13 17:20:37 user nova-compute[75100]:     </nova:instance>
Nov 13 17:20:37 user nova-compute[75100]:   </metadata>
Nov 13 17:20:37 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:20:37 user nova-compute[75100]:     <system>
Nov 13 17:20:37 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:20:37 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:20:37 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:20:37 user nova-compute[75100]:       <entry name="serial">f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e</entry>
Nov 13 17:20:37 user nova-compute[75100]:       <entry name="uuid">f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e</entry>
Nov 13 17:20:37 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:20:37 user nova-compute[75100]:     </system>
Nov 13 17:20:37 user nova-compute[75100]:   </sysinfo>
Nov 13 17:20:37 user nova-compute[75100]:   <os>
Nov 13 17:20:37 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:20:37 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:20:37 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:20:37 user nova-compute[75100]:   </os>
Nov 13 17:20:37 user nova-compute[75100]:   <features>
Nov 13 17:20:37 user nova-compute[75100]:     <acpi/>
Nov 13 17:20:37 user nova-compute[75100]:     <apic/>
Nov 13 17:20:37 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:20:37 user nova-compute[75100]:   </features>
Nov 13 17:20:37 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:20:37 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:20:37 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:20:37 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:20:37 user nova-compute[75100]:   </clock>
Nov 13 17:20:37 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:20:37 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:20:37 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:20:37 user nova-compute[75100]:   </cpu>
Nov 13 17:20:37 user nova-compute[75100]:   <devices>
Nov 13 17:20:37 user nova-compute[75100]:     <disk type="file" device="cdrom">
Nov 13 17:20:37 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 17:20:37 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e/disk.config"/>
Nov 13 17:20:37 user nova-compute[75100]:       <target dev="hda" bus="ide"/>
Nov 13 17:20:37 user nova-compute[75100]:     </disk>
Nov 13 17:20:37 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:20:37 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:20:37 user nova-compute[75100]:       <source dev="/dev/sdd"/>
Nov 13 17:20:37 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:20:37 user nova-compute[75100]:       <serial>2ddab20d-ea6e-468d-be6d-6c9a28b3141d</serial>
Nov 13 17:20:37 user nova-compute[75100]:     </disk>
Nov 13 17:20:37 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:20:37 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:20:37 user nova-compute[75100]:       <source dev="/dev/sde"/>
Nov 13 17:20:37 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:20:37 user nova-compute[75100]:       <serial>bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78</serial>
Nov 13 17:20:37 user nova-compute[75100]:     </disk>
Nov 13 17:20:37 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:20:37 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:20:37 user nova-compute[75100]:       <source dev="/dev/sdf"/>
Nov 13 17:20:37 user nova-compute[75100]:       <target dev="vdc" bus="virtio"/>
Nov 13 17:20:37 user nova-compute[75100]:       <serial>b32f771b-b2ae-43cc-8578-753ba1081163</serial>
Nov 13 17:20:37 user nova-compute[75100]:     </disk>
Nov 13 17:20:37 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:20:37 user nova-compute[75100]:       <mac address="fa:16:3e:ef:bc:c8"/>
Nov 13 17:20:37 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:37 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:20:37 user nova-compute[75100]:       <target dev="tap8d9c51ce-9d"/>
Nov 13 17:20:37 user nova-compute[75100]:     </interface>
Nov 13 17:20:37 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:20:37 user nova-compute[75100]:       <mac address="fa:16:3e:1e:aa:32"/>
Nov 13 17:20:37 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:37 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:20:37 user nova-compute[75100]:       <target dev="tapa020143e-a8"/>
Nov 13 17:20:37 user nova-compute[75100]:     </interface>
Nov 13 17:20:37 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:20:37 user nova-compute[75100]:       <mac address="fa:16:3e:ec:f2:c7"/>
Nov 13 17:20:37 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:37 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:20:37 user nova-compute[75100]:       <target dev="tap6c1300f5-b3"/>
Nov 13 17:20:37 user nova-compute[75100]:     </interface>
Nov 13 17:20:37 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:20:37 user nova-compute[75100]:       <mac address="fa:16:3e:6b:dd:6b"/>
Nov 13 17:20:37 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:37 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:20:37 user nova-compute[75100]:       <target dev="tapc69ece98-a1"/>
Nov 13 17:20:37 user nova-compute[75100]:     </interface>
Nov 13 17:20:37 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:20:37 user nova-compute[75100]:       <mac address="fa:16:3e:b5:6b:dc"/>
Nov 13 17:20:37 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:37 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:20:37 user nova-compute[75100]:       <target dev="tapb401007f-7e"/>
Nov 13 17:20:37 user nova-compute[75100]:     </interface>
Nov 13 17:20:37 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:20:37 user nova-compute[75100]:       <mac address="fa:16:3e:17:65:3b"/>
Nov 13 17:20:37 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:37 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:20:37 user nova-compute[75100]:       <target dev="tapf74a46ed-40"/>
Nov 13 17:20:37 user nova-compute[75100]:     </interface>
Nov 13 17:20:37 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:20:37 user nova-compute[75100]:       <mac address="fa:16:3e:71:c2:19"/>
Nov 13 17:20:37 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:37 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:20:37 user nova-compute[75100]:       <target dev="tape8660440-37"/>
Nov 13 17:20:37 user nova-compute[75100]:     </interface>
Nov 13 17:20:37 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:20:37 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e/console.log" append="off"/>
Nov 13 17:20:37 user nova-compute[75100]:     </serial>
Nov 13 17:20:37 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:20:37 user nova-compute[75100]:     <video>
Nov 13 17:20:37 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:20:37 user nova-compute[75100]:     </video>
Nov 13 17:20:37 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:20:37 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:20:37 user nova-compute[75100]:     </rng>
Nov 13 17:20:37 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:20:37 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:20:37 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:20:37 user nova-compute[75100]:     </memballoon>
Nov 13 17:20:37 user nova-compute[75100]:   </devices>
Nov 13 17:20:37 user nova-compute[75100]: </domain>
Nov 13 17:20:37 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:bc:c8,bridge_name='br-int',has_traffic_filtering=True,id=8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340,network=Network(5bf875da-58d1-4ba4-8e2a-6cca9e5199ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9c51ce-9d') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:bc:c8,bridge_name='br-int',has_traffic_filtering=True,id=8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340,network=Network(5bf875da-58d1-4ba4-8e2a-6cca9e5199ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9c51ce-9d') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0c6cab01-2192-5b42-a2cf-e7743f552489', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d9c51ce-9d, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d9c51ce-9d, col_values=(('qos', UUID('fce72674-8b9a-4d14-be10-66abb180f2ed')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d9c51ce-9d, col_values=(('external_ids', {'iface-id': '8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:bc:c8', 'vm-uuid': 'f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: INFO os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:bc:c8,bridge_name='br-int',has_traffic_filtering=True,id=8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340,network=Network(5bf875da-58d1-4ba4-8e2a-6cca9e5199ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9c51ce-9d')
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=a020143e-a824-46fb-8988-9de41419b4cc,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa020143e-a8') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=a020143e-a824-46fb-8988-9de41419b4cc,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa020143e-a8') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea3edfc3-bd00-5c39-8396-38a358cf62e3', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa020143e-a8, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa020143e-a8, col_values=(('qos', UUID('b4798c8a-21ce-4c9b-a63e-239104af286d')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa020143e-a8, col_values=(('external_ids', {'iface-id': 'a020143e-a824-46fb-8988-9de41419b4cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:aa:32', 'vm-uuid': 'f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: INFO os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=a020143e-a824-46fb-8988-9de41419b4cc,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa020143e-a8')
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f2:c7,bridge_name='br-int',has_traffic_filtering=True,id=6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c1300f5-b3') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f2:c7,bridge_name='br-int',has_traffic_filtering=True,id=6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c1300f5-b3') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ca2fbf3-d25f-56ec-be07-bd2c41f5f2cf', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c1300f5-b3, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c1300f5-b3, col_values=(('qos', UUID('5ba98148-02fd-4c21-b2df-2cda0bc11e23')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c1300f5-b3, col_values=(('external_ids', {'iface-id': '6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:f2:c7', 'vm-uuid': 'f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: INFO os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f2:c7,bridge_name='br-int',has_traffic_filtering=True,id=6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c1300f5-b3')
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:dd:6b,bridge_name='br-int',has_traffic_filtering=True,id=c69ece98-a175-4524-b5b6-acf4d6804db7,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69ece98-a1') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:dd:6b,bridge_name='br-int',has_traffic_filtering=True,id=c69ece98-a175-4524-b5b6-acf4d6804db7,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69ece98-a1') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6eda2654-1f39-541f-ac4d-c0fd8b8b1451', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc69ece98-a1, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc69ece98-a1, col_values=(('qos', UUID('e5002fcf-08fc-4150-9e1f-08e7ffbab4e0')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc69ece98-a1, col_values=(('external_ids', {'iface-id': 'c69ece98-a175-4524-b5b6-acf4d6804db7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:dd:6b', 'vm-uuid': 'f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: INFO os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:dd:6b,bridge_name='br-int',has_traffic_filtering=True,id=c69ece98-a175-4524-b5b6-acf4d6804db7,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69ece98-a1')
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6b:dc,bridge_name='br-int',has_traffic_filtering=True,id=b401007f-7e49-4a6e-9ac9-1da782cfea31,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb401007f-7e') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6b:dc,bridge_name='br-int',has_traffic_filtering=True,id=b401007f-7e49-4a6e-9ac9-1da782cfea31,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb401007f-7e') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '818b3022-3ec5-586d-9dbf-dbccca7ef4da', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb401007f-7e, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb401007f-7e, col_values=(('qos', UUID('2c1023ab-5360-4ed2-9371-7b3fafcf64fb')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb401007f-7e, col_values=(('external_ids', {'iface-id': 'b401007f-7e49-4a6e-9ac9-1da782cfea31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:6b:dc', 'vm-uuid': 'f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: INFO os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6b:dc,bridge_name='br-int',has_traffic_filtering=True,id=b401007f-7e49-4a6e-9ac9-1da782cfea31,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb401007f-7e')
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=f74a46ed-40fb-40ab-ad63-74b69ab3a6ef,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74a46ed-40') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=f74a46ed-40fb-40ab-ad63-74b69ab3a6ef,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74a46ed-40') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cce664b-7860-5d25-b97b-a3976a997a5e', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf74a46ed-40, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf74a46ed-40, col_values=(('qos', UUID('1d7063d4-a24f-40dc-ab66-0e1a5e6b535f')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf74a46ed-40, col_values=(('external_ids', {'iface-id': 'f74a46ed-40fb-40ab-ad63-74b69ab3a6ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:65:3b', 'vm-uuid': 'f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: INFO os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=f74a46ed-40fb-40ab-ad63-74b69ab3a6ef,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74a46ed-40')
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "address": "fa:16:3e:71:c2:19", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8660440-37", "ovs_interfaceid": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "address": "fa:16:3e:71:c2:19", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8660440-37", "ovs_interfaceid": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c2:19,bridge_name='br-int',has_traffic_filtering=True,id=e8660440-37a5-4e0e-a0cd-99ab02aaa577,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8660440-37') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c2:19,bridge_name='br-int',has_traffic_filtering=True,id=e8660440-37a5-4e0e-a0cd-99ab02aaa577,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8660440-37') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '865020a9-9305-52ba-abd8-920f2e01eb8e', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8660440-37, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8660440-37, col_values=(('qos', UUID('aba0eeb2-2425-4ffe-9717-bf329fd1330d')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8660440-37, col_values=(('external_ids', {'iface-id': 'e8660440-37a5-4e0e-a0cd-99ab02aaa577', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:c2:19', 'vm-uuid': 'f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:37 user nova-compute[75100]: INFO os_vif [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c2:19,bridge_name='br-int',has_traffic_filtering=True,id=e8660440-37a5-4e0e-a0cd-99ab02aaa577,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8660440-37')
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] No BDM found with device name hda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] No VIF found with MAC fa:16:3e:ef:bc:c8, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:20:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] No VIF found with MAC fa:16:3e:b5:6b:dc, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:20:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Using config drive
Nov 13 17:20:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Creating config drive at /opt/stack/data/nova/instances/f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e/disk.config
Nov 13 17:20:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps6cjrzl7 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:20:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmps6cjrzl7" returned: 0 in 0.078s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:20:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-8bf112be-0eb1-4254-9c58-0e0dda24ce3b req-bf55083e-33a8-401e-befc-7b9ade12571e service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8bf112be-0eb1-4254-9c58-0e0dda24ce3b req-bf55083e-33a8-401e-befc-7b9ade12571e service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8bf112be-0eb1-4254-9c58-0e0dda24ce3b req-bf55083e-33a8-401e-befc-7b9ade12571e service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8bf112be-0eb1-4254-9c58-0e0dda24ce3b req-bf55083e-33a8-401e-befc-7b9ade12571e service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-8bf112be-0eb1-4254-9c58-0e0dda24ce3b req-bf55083e-33a8-401e-befc-7b9ade12571e service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:40 user nova-compute[75100]: WARNING nova.compute.manager [req-8bf112be-0eb1-4254-9c58-0e0dda24ce3b req-bf55083e-33a8-401e-befc-7b9ade12571e service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 for instance with vm_state building and task_state spawning.
Nov 13 17:20:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-16880b30-b141-4ed7-8cfd-06eef4d27a6d req-07584da0-2c73-4bb1-83d2-5fab60a66cf3 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-16880b30-b141-4ed7-8cfd-06eef4d27a6d req-07584da0-2c73-4bb1-83d2-5fab60a66cf3 service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-16880b30-b141-4ed7-8cfd-06eef4d27a6d req-07584da0-2c73-4bb1-83d2-5fab60a66cf3 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-16880b30-b141-4ed7-8cfd-06eef4d27a6d req-07584da0-2c73-4bb1-83d2-5fab60a66cf3 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-16880b30-b141-4ed7-8cfd-06eef4d27a6d req-07584da0-2c73-4bb1-83d2-5fab60a66cf3 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:40 user nova-compute[75100]: WARNING nova.compute.manager [req-16880b30-b141-4ed7-8cfd-06eef4d27a6d req-07584da0-2c73-4bb1-83d2-5fab60a66cf3 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc for instance with vm_state building and task_state spawning.
Nov 13 17:20:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5a6af7-7565-4df1-a7bd-ce3ec3d851fd req-25485207-953f-41e7-aaec-cd9d9e5ad8ee service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5a6af7-7565-4df1-a7bd-ce3ec3d851fd req-25485207-953f-41e7-aaec-cd9d9e5ad8ee service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5a6af7-7565-4df1-a7bd-ce3ec3d851fd req-25485207-953f-41e7-aaec-cd9d9e5ad8ee service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5a6af7-7565-4df1-a7bd-ce3ec3d851fd req-25485207-953f-41e7-aaec-cd9d9e5ad8ee service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5a6af7-7565-4df1-a7bd-ce3ec3d851fd req-25485207-953f-41e7-aaec-cd9d9e5ad8ee service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:41 user nova-compute[75100]: WARNING nova.compute.manager [req-5f5a6af7-7565-4df1-a7bd-ce3ec3d851fd req-25485207-953f-41e7-aaec-cd9d9e5ad8ee service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-b401007f-7e49-4a6e-9ac9-1da782cfea31 for instance with vm_state building and task_state spawning.
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-ea045803-fb2a-438b-a3c9-8ed522e47d56 req-b4f99cf7-db4f-49cd-bc0d-b8757cee022f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ea045803-fb2a-438b-a3c9-8ed522e47d56 req-b4f99cf7-db4f-49cd-bc0d-b8757cee022f service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ea045803-fb2a-438b-a3c9-8ed522e47d56 req-b4f99cf7-db4f-49cd-bc0d-b8757cee022f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ea045803-fb2a-438b-a3c9-8ed522e47d56 req-b4f99cf7-db4f-49cd-bc0d-b8757cee022f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-ea045803-fb2a-438b-a3c9-8ed522e47d56 req-b4f99cf7-db4f-49cd-bc0d-b8757cee022f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:42 user nova-compute[75100]: WARNING nova.compute.manager [req-ea045803-fb2a-438b-a3c9-8ed522e47d56 req-b4f99cf7-db4f-49cd-bc0d-b8757cee022f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 for instance with vm_state building and task_state spawning.
Nov 13 17:20:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:42 user nova-compute[75100]: WARNING nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc for instance with vm_state building and task_state spawning.
Nov 13 17:20:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:42 user nova-compute[75100]: WARNING nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a for instance with vm_state building and task_state spawning.
Nov 13 17:20:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:42 user nova-compute[75100]: WARNING nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a for instance with vm_state building and task_state spawning.
Nov 13 17:20:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:42 user nova-compute[75100]: WARNING nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-c69ece98-a175-4524-b5b6-acf4d6804db7 for instance with vm_state building and task_state spawning.
Nov 13 17:20:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:42 user nova-compute[75100]: WARNING nova.compute.manager [req-faaaf510-2d81-4c39-a4c9-b38ee4540ad4 req-fca5587a-2adb-4cc1-837a-f66622bc30fa service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-c69ece98-a175-4524-b5b6-acf4d6804db7 for instance with vm_state building and task_state spawning.
Nov 13 17:20:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:43 user nova-compute[75100]: WARNING nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-b401007f-7e49-4a6e-9ac9-1da782cfea31 for instance with vm_state building and task_state spawning.
Nov 13 17:20:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:43 user nova-compute[75100]: WARNING nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef for instance with vm_state building and task_state spawning.
Nov 13 17:20:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:43 user nova-compute[75100]: WARNING nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef for instance with vm_state building and task_state spawning.
Nov 13 17:20:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:43 user nova-compute[75100]: WARNING nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-e8660440-37a5-4e0e-a0cd-99ab02aaa577 for instance with vm_state building and task_state spawning.
Nov 13 17:20:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:20:43 user nova-compute[75100]: WARNING nova.compute.manager [req-6e703ffd-aec9-4a89-9c68-d672d75e5f7d req-bea3a3b1-78fd-45d5-8fcf-275376d2102b service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-e8660440-37a5-4e0e-a0cd-99ab02aaa577 for instance with vm_state building and task_state spawning.
Nov 13 17:20:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:20:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:20:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Instance spawned successfully.
Nov 13 17:20:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:20:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:20:44 user nova-compute[75100]: INFO nova.compute.manager [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Took 12.32 seconds to spawn the instance on the hypervisor.
Nov 13 17:20:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:20:44 user nova-compute[75100]: INFO nova.compute.manager [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Took 29.50 seconds to build instance.
Nov 13 17:20:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-54c3af8c-91d7-4cdd-b73d-84dd4d3fb994 tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.666s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:20:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:20:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "31779592-a9f2-4aae-a658-e055ec832b37" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "31779592-a9f2-4aae-a658-e055ec832b37" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG nova.objects.instance [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lazy-loading 'flavor' on Instance uuid 31779592-a9f2-4aae-a658-e055ec832b37 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "31779592-a9f2-4aae-a658-e055ec832b37" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "31779592-a9f2-4aae-a658-e055ec832b37" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "31779592-a9f2-4aae-a658-e055ec832b37" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:12 user nova-compute[75100]: INFO nova.compute.manager [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Attaching volume 01c45f8c-4504-4320-b177-b7b20dc61f10 to /dev/vdb
Nov 13 17:21:12 user nova-compute[75100]: DEBUG os_brick.utils [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c973a4-634a-43a5-add9-7e9188950439]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[683b4f74-84eb-4e47-b04c-ee0a0fc49664]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c04a52-d6e1-4c4e-93c8-16b5e71fd5e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5360d10-99ce-414d-939d-96741d39333e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:21:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:21:13 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:21:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef23339-c659-4b7b-82b8-d71e584afece]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:21:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:21:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:21:13 user nova-compute[75100]: DEBUG os_brick.utils [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:13 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Updating existing volume attachment record: a0747033-f08a-4654-984a-558294f2b5a6 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:21:13 user nova-compute[75100]: INFO nova.compute.manager [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Rescuing
Nov 13 17:21:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquired lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Updating instance_info_cache with network_info: [{"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Releasing lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-b15b5eb0-9ded-4369-a71f-52ee1f40f3ae req-4b67e495-b010-4a54-9db7-d92336d59a13 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received event network-vif-unplugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b15b5eb0-9ded-4369-a71f-52ee1f40f3ae req-4b67e495-b010-4a54-9db7-d92336d59a13 service nova] Acquiring lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b15b5eb0-9ded-4369-a71f-52ee1f40f3ae req-4b67e495-b010-4a54-9db7-d92336d59a13 service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b15b5eb0-9ded-4369-a71f-52ee1f40f3ae req-4b67e495-b010-4a54-9db7-d92336d59a13 service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-b15b5eb0-9ded-4369-a71f-52ee1f40f3ae req-4b67e495-b010-4a54-9db7-d92336d59a13 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] No waiting events found dispatching network-vif-unplugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:21:14 user nova-compute[75100]: WARNING nova.compute.manager [req-b15b5eb0-9ded-4369-a71f-52ee1f40f3ae req-4b67e495-b010-4a54-9db7-d92336d59a13 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received unexpected event network-vif-unplugged-daca5488-cacc-44a2-9798-4da784566bad for instance with vm_state active and task_state rescuing.
Nov 13 17:21:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Instance destroyed successfully.
Nov 13 17:21:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Attempting rescue
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75100) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 17:21:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Creating image(s)
Nov 13 17:21:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "/opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "/opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7f3f3c5b-5128-4356-a995-fe3265f49fe1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.245s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue" returned: 0 in 0.051s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'migration_context' on Instance uuid 7f3f3c5b-5128-4356-a995-fe3265f49fe1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.objects.base [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<7f3f3c5b-5128-4356-a995-fe3265f49fe1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Start _get_guest_xml network_info=[{"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "vif_mac": "fa:16:3e:85:dc:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'resources' on Instance uuid 7f3f3c5b-5128-4356-a995-fe3265f49fe1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.objects.base [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<7f3f3c5b-5128-4356-a995-fe3265f49fe1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'numa_topology' on Instance uuid 7f3f3c5b-5128-4356-a995-fe3265f49fe1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.objects.base [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<7f3f3c5b-5128-4356-a995-fe3265f49fe1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:21:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:21:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7f3f3c5b-5128-4356-a995-fe3265f49fe1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.objects.base [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<7f3f3c5b-5128-4356-a995-fe3265f49fe1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1848893497',display_name='tempest-ServerRescueNegativeTestJSON-server-1848893497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1848893497',id=3,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:19:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6c1d1cfd844465e85239be73eb73cec',ramdisk_id='',reservation_id='r-xeiyvn89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1273984533',owner_user_name='tempest-ServerRescueNegativeTestJSON-1273984533-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:42Z,user_data=None,user_id='33657093c7ab4112994a1b7e997cfb34',uuid=7f3f3c5b-5128-4356-a995-fe3265f49fe1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "vif_mac": "fa:16:3e:85:dc:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converting VIF {"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "vif_mac": "fa:16:3e:85:dc:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=daca5488-cacc-44a2-9798-4da784566bad,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaca5488-ca') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f3f3c5b-5128-4356-a995-fe3265f49fe1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.objects.base [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<7f3f3c5b-5128-4356-a995-fe3265f49fe1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:21:15 user nova-compute[75100]:   <uuid>7f3f3c5b-5128-4356-a995-fe3265f49fe1</uuid>
Nov 13 17:21:15 user nova-compute[75100]:   <name>instance-00000003</name>
Nov 13 17:21:15 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:21:15 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:21:15 user nova-compute[75100]:   <metadata>
Nov 13 17:21:15 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:21:15 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:21:15 user nova-compute[75100]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1848893497</nova:name>
Nov 13 17:21:15 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:21:15</nova:creationTime>
Nov 13 17:21:15 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:21:15 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:21:15 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:21:15 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:21:15 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:21:15 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:21:15 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:21:15 user nova-compute[75100]:       <nova:owner>
Nov 13 17:21:15 user nova-compute[75100]:         <nova:user uuid="33657093c7ab4112994a1b7e997cfb34">tempest-ServerRescueNegativeTestJSON-1273984533-project-member</nova:user>
Nov 13 17:21:15 user nova-compute[75100]:         <nova:project uuid="d6c1d1cfd844465e85239be73eb73cec">tempest-ServerRescueNegativeTestJSON-1273984533</nova:project>
Nov 13 17:21:15 user nova-compute[75100]:       </nova:owner>
Nov 13 17:21:15 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:21:15 user nova-compute[75100]:       <nova:ports>
Nov 13 17:21:15 user nova-compute[75100]:         <nova:port uuid="daca5488-cacc-44a2-9798-4da784566bad">
Nov 13 17:21:15 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:21:15 user nova-compute[75100]:         </nova:port>
Nov 13 17:21:15 user nova-compute[75100]:       </nova:ports>
Nov 13 17:21:15 user nova-compute[75100]:     </nova:instance>
Nov 13 17:21:15 user nova-compute[75100]:   </metadata>
Nov 13 17:21:15 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:21:15 user nova-compute[75100]:     <system>
Nov 13 17:21:15 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:21:15 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:21:15 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:21:15 user nova-compute[75100]:       <entry name="serial">7f3f3c5b-5128-4356-a995-fe3265f49fe1</entry>
Nov 13 17:21:15 user nova-compute[75100]:       <entry name="uuid">7f3f3c5b-5128-4356-a995-fe3265f49fe1</entry>
Nov 13 17:21:15 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:21:15 user nova-compute[75100]:     </system>
Nov 13 17:21:15 user nova-compute[75100]:   </sysinfo>
Nov 13 17:21:15 user nova-compute[75100]:   <os>
Nov 13 17:21:15 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:21:15 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:21:15 user nova-compute[75100]:   </os>
Nov 13 17:21:15 user nova-compute[75100]:   <features>
Nov 13 17:21:15 user nova-compute[75100]:     <acpi/>
Nov 13 17:21:15 user nova-compute[75100]:     <apic/>
Nov 13 17:21:15 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:21:15 user nova-compute[75100]:   </features>
Nov 13 17:21:15 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:21:15 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:21:15 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:21:15 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:21:15 user nova-compute[75100]:   </clock>
Nov 13 17:21:15 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:21:15 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:21:15 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:21:15 user nova-compute[75100]:   </cpu>
Nov 13 17:21:15 user nova-compute[75100]:   <devices>
Nov 13 17:21:15 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:21:15 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:21:15 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue"/>
Nov 13 17:21:15 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:21:15 user nova-compute[75100]:     </disk>
Nov 13 17:21:15 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:21:15 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:21:15 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk"/>
Nov 13 17:21:15 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:21:15 user nova-compute[75100]:     </disk>
Nov 13 17:21:15 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:21:15 user nova-compute[75100]:       <mac address="fa:16:3e:85:dc:26"/>
Nov 13 17:21:15 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:21:15 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:21:15 user nova-compute[75100]:       <target dev="tapdaca5488-ca"/>
Nov 13 17:21:15 user nova-compute[75100]:     </interface>
Nov 13 17:21:15 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:21:15 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/console.log" append="off"/>
Nov 13 17:21:15 user nova-compute[75100]:     </serial>
Nov 13 17:21:15 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:21:15 user nova-compute[75100]:     <video>
Nov 13 17:21:15 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:21:15 user nova-compute[75100]:     </video>
Nov 13 17:21:15 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:21:15 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:21:15 user nova-compute[75100]:     </rng>
Nov 13 17:21:15 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:21:15 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:21:15 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:21:15 user nova-compute[75100]:     </memballoon>
Nov 13 17:21:15 user nova-compute[75100]:   </devices>
Nov 13 17:21:15 user nova-compute[75100]: </domain>
Nov 13 17:21:15 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:21:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Instance destroyed successfully.
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:21:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No VIF found with MAC fa:16:3e:85:dc:26, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:21:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:21:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-bc61da62-972c-48b9-a16f-1c43b31082c3 req-8f712f11-b32c-4e0d-8b4a-ee26f5ea5606 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received event network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bc61da62-972c-48b9-a16f-1c43b31082c3 req-8f712f11-b32c-4e0d-8b4a-ee26f5ea5606 service nova] Acquiring lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bc61da62-972c-48b9-a16f-1c43b31082c3 req-8f712f11-b32c-4e0d-8b4a-ee26f5ea5606 service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bc61da62-972c-48b9-a16f-1c43b31082c3 req-8f712f11-b32c-4e0d-8b4a-ee26f5ea5606 service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-bc61da62-972c-48b9-a16f-1c43b31082c3 req-8f712f11-b32c-4e0d-8b4a-ee26f5ea5606 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] No waiting events found dispatching network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:21:16 user nova-compute[75100]: WARNING nova.compute.manager [req-bc61da62-972c-48b9-a16f-1c43b31082c3 req-8f712f11-b32c-4e0d-8b4a-ee26f5ea5606 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received unexpected event network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad for instance with vm_state active and task_state rescuing.
Nov 13 17:21:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnsZWvTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:17 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:17 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:17 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:21:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[210b0800-bbad-42dd-88ac-4431ceada2ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:21:17 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cbd284-c2fe-4f16-a3af-58287b1e82bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10] added
Nov 13 17:21:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:17 user nova-compute[75100]: INFO nova.compute.manager [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] instance snapshotting
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bad9666-f346-418c-bc42-3413a2347915]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[18853801-f899-40a6-b649-dfd2d565c388]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnsZWvTg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnsZWvTg" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[05176aa7-ab01-4cf2-ac77-65a4cefb7ea2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cnsZWvTg'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Beginning live snapshot process
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[51571c3d-70d9-41ab-a7b3-c1e633aae212]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b34088-c350-408a-b5f5-87f6a14ea657]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf168d19-f414-41b0-a044-ce1dd90a6bbf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10, portal: 172.16.0.220,3260]
Nov 13 17:21:17 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10, portal: 172.16.0.220,3260] successful.
Nov 13 17:21:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd279ec-11e7-461f-bdd0-ed2c5ff82023]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1894a070-c81a-41fb-9a9a-9f3e2709bf20]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 (non-flash)
Nov 13 17:21:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:17 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 (non-flash)
Nov 13 17:21:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[077a23a2-66aa-40c4-9470-295b88531e1e]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnsZWvTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3t3n695w/e409e402ab7d45cb99beb5235e1ebbe6.delta 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp3t3n695w/e409e402ab7d45cb99beb5235e1ebbe6.delta 1073741824" returned: 0 in 0.047s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75100) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 13 17:21:18 user nova-compute[75100]: INFO nova.virt.libvirt.host [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] UEFI support detected
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23134383335616164', 'path': '/dev/sdg'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134383335616164', 'path': '/dev/sdg'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.objects.instance [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lazy-loading 'flavor' on Instance uuid 31779592-a9f2-4aae-a658-e055ec832b37 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:21:18 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:21:18 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:21:18 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:21:18 user nova-compute[75100]:   <serial>01c45f8c-4504-4320-b177-b7b20dc61f10</serial>
Nov 13 17:21:18 user nova-compute[75100]: </disk>
Nov 13 17:21:18 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-fff997bd-3b5c-4ad3-b150-3af7b4fec86a req-502acce4-d089-4e01-90b1-6329ff975806 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Received event network-changed-15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-fff997bd-3b5c-4ad3-b150-3af7b4fec86a req-502acce4-d089-4e01-90b1-6329ff975806 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Refreshing instance network info cache due to event network-changed-15335f7b-d811-486f-a5ce-3643fa79fbc7. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fff997bd-3b5c-4ad3-b150-3af7b4fec86a req-502acce4-d089-4e01-90b1-6329ff975806 service nova] Acquiring lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fff997bd-3b5c-4ad3-b150-3af7b4fec86a req-502acce4-d089-4e01-90b1-6329ff975806 service nova] Acquired lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.network.neutron [req-fff997bd-3b5c-4ad3-b150-3af7b4fec86a req-502acce4-d089-4e01-90b1-6329ff975806 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Refreshing network info cache for port 15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-1ea562dd-0ba0-490f-91f8-ae509d49c102 req-7dc6999f-7046-4e9c-a6cd-d9424a20a90f service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received event network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1ea562dd-0ba0-490f-91f8-ae509d49c102 req-7dc6999f-7046-4e9c-a6cd-d9424a20a90f service nova] Acquiring lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1ea562dd-0ba0-490f-91f8-ae509d49c102 req-7dc6999f-7046-4e9c-a6cd-d9424a20a90f service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1ea562dd-0ba0-490f-91f8-ae509d49c102 req-7dc6999f-7046-4e9c-a6cd-d9424a20a90f service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-1ea562dd-0ba0-490f-91f8-ae509d49c102 req-7dc6999f-7046-4e9c-a6cd-d9424a20a90f service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] No waiting events found dispatching network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:21:18 user nova-compute[75100]: WARNING nova.compute.manager [req-1ea562dd-0ba0-490f-91f8-ae509d49c102 req-7dc6999f-7046-4e9c-a6cd-d9424a20a90f service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received unexpected event network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad for instance with vm_state active and task_state rescuing.
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-1ea562dd-0ba0-490f-91f8-ae509d49c102 req-7dc6999f-7046-4e9c-a6cd-d9424a20a90f service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received event network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1ea562dd-0ba0-490f-91f8-ae509d49c102 req-7dc6999f-7046-4e9c-a6cd-d9424a20a90f service nova] Acquiring lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1ea562dd-0ba0-490f-91f8-ae509d49c102 req-7dc6999f-7046-4e9c-a6cd-d9424a20a90f service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1ea562dd-0ba0-490f-91f8-ae509d49c102 req-7dc6999f-7046-4e9c-a6cd-d9424a20a90f service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-1ea562dd-0ba0-490f-91f8-ae509d49c102 req-7dc6999f-7046-4e9c-a6cd-d9424a20a90f service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] No waiting events found dispatching network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:21:18 user nova-compute[75100]: WARNING nova.compute.manager [req-1ea562dd-0ba0-490f-91f8-ae509d49c102 req-7dc6999f-7046-4e9c-a6cd-d9424a20a90f service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received unexpected event network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad for instance with vm_state active and task_state rescuing.
Nov 13 17:21:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Updating instance_info_cache with network_info: [{"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] COPY block job progress, current cursor: 24838144 final cursor: 75497472 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] No VIF found with MAC fa:16:3e:9d:22:c1, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-fff997bd-3b5c-4ad3-b150-3af7b4fec86a req-502acce4-d089-4e01-90b1-6329ff975806 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updated VIF entry in instance network info cache for port 15335f7b-d811-486f-a5ce-3643fa79fbc7. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-fff997bd-3b5c-4ad3-b150-3af7b4fec86a req-502acce4-d089-4e01-90b1-6329ff975806 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updating instance_info_cache with network_info: [{"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f6b8da60-ac54-4db9-adda-8856a2a04e36 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fff997bd-3b5c-4ad3-b150-3af7b4fec86a req-502acce4-d089-4e01-90b1-6329ff975806 service nova] Releasing lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:21:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb5f6f80-5d27-4541-91ee-ea24fcdfb6e6 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "31779592-a9f2-4aae-a658-e055ec832b37" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.138s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:21:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 17:21:20 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3t3n695w/e409e402ab7d45cb99beb5235e1ebbe6.delta /opt/stack/data/nova/instances/snapshots/tmp3t3n695w/e409e402ab7d45cb99beb5235e1ebbe6 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp3t3n695w/e409e402ab7d45cb99beb5235e1ebbe6.delta /opt/stack/data/nova/instances/snapshots/tmp3t3n695w/e409e402ab7d45cb99beb5235e1ebbe6" returned: 0 in 0.444s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Snapshot extracted, beginning image upload
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "31779592-a9f2-4aae-a658-e055ec832b37" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "31779592-a9f2-4aae-a658-e055ec832b37" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "31779592-a9f2-4aae-a658-e055ec832b37-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "31779592-a9f2-4aae-a658-e055ec832b37-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "31779592-a9f2-4aae-a658-e055ec832b37-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:20 user nova-compute[75100]: INFO nova.compute.manager [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Terminating instance
Nov 13 17:21:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-91840a67-2a32-4fb1-9917-52e50dfc21ff req-844a8999-0458-4698-a1de-49a11ca33e6b service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-changed-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-91840a67-2a32-4fb1-9917-52e50dfc21ff req-844a8999-0458-4698-a1de-49a11ca33e6b service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Refreshing instance network info cache due to event network-changed-4d8ea93b-b607-4f22-ad01-9577465b5997. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-91840a67-2a32-4fb1-9917-52e50dfc21ff req-844a8999-0458-4698-a1de-49a11ca33e6b service nova] Acquiring lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-91840a67-2a32-4fb1-9917-52e50dfc21ff req-844a8999-0458-4698-a1de-49a11ca33e6b service nova] Acquired lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-91840a67-2a32-4fb1-9917-52e50dfc21ff req-844a8999-0458-4698-a1de-49a11ca33e6b service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Refreshing network info cache for port 4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-cd7c8b5f-a830-40c5-bc87-2dc8477c065d req-7b4564d0-d41d-4976-9415-93228df13e03 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Received event network-vif-unplugged-b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cd7c8b5f-a830-40c5-bc87-2dc8477c065d req-7b4564d0-d41d-4976-9415-93228df13e03 service nova] Acquiring lock "31779592-a9f2-4aae-a658-e055ec832b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cd7c8b5f-a830-40c5-bc87-2dc8477c065d req-7b4564d0-d41d-4976-9415-93228df13e03 service nova] Lock "31779592-a9f2-4aae-a658-e055ec832b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cd7c8b5f-a830-40c5-bc87-2dc8477c065d req-7b4564d0-d41d-4976-9415-93228df13e03 service nova] Lock "31779592-a9f2-4aae-a658-e055ec832b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-cd7c8b5f-a830-40c5-bc87-2dc8477c065d req-7b4564d0-d41d-4976-9415-93228df13e03 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] No waiting events found dispatching network-vif-unplugged-b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-cd7c8b5f-a830-40c5-bc87-2dc8477c065d req-7b4564d0-d41d-4976-9415-93228df13e03 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Received event network-vif-unplugged-b88af3f7-eb48-47b2-84c0-b991584a6826 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-91840a67-2a32-4fb1-9917-52e50dfc21ff req-844a8999-0458-4698-a1de-49a11ca33e6b service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updated VIF entry in instance network info cache for port 4d8ea93b-b607-4f22-ad01-9577465b5997. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-91840a67-2a32-4fb1-9917-52e50dfc21ff req-844a8999-0458-4698-a1de-49a11ca33e6b service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating instance_info_cache with network_info: [{"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-91840a67-2a32-4fb1-9917-52e50dfc21ff req-844a8999-0458-4698-a1de-49a11ca33e6b service nova] Releasing lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:21:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Instance destroyed successfully.
Nov 13 17:21:21 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lazy-loading 'resources' on Instance uuid 31779592-a9f2-4aae-a658-e055ec832b37 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1551466350',display_name='tempest-DeleteServersTestJSON-server-1551466350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1551466350',id=1,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:19:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46e9dffd99824724a921a72499143852',ramdisk_id='',reservation_id='r-sfs013iy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-567642559',owner_user_name='tempest-DeleteServersTestJSON-567642559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:19:42Z,user_data=None,user_id='cb423a49f7954aa29f976f2f5d0e27ec',uuid=31779592-a9f2-4aae-a658-e055ec832b37,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b88af3f7-eb48-47b2-84c0-b991584a6826", "address": "fa:16:3e:9d:22:c1", "network": {"id": "7593ddf6-1ad8-4498-9cbd-3ad9b77db488", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1497148107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e9dffd99824724a921a72499143852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88af3f7-eb", "ovs_interfaceid": "b88af3f7-eb48-47b2-84c0-b991584a6826", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Converting VIF {"id": "b88af3f7-eb48-47b2-84c0-b991584a6826", "address": "fa:16:3e:9d:22:c1", "network": {"id": "7593ddf6-1ad8-4498-9cbd-3ad9b77db488", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1497148107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46e9dffd99824724a921a72499143852", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb88af3f7-eb", "ovs_interfaceid": "b88af3f7-eb48-47b2-84c0-b991584a6826", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:22:c1,bridge_name='br-int',has_traffic_filtering=True,id=b88af3f7-eb48-47b2-84c0-b991584a6826,network=Network(7593ddf6-1ad8-4498-9cbd-3ad9b77db488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88af3f7-eb') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_vif [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:22:c1,bridge_name='br-int',has_traffic_filtering=True,id=b88af3f7-eb48-47b2-84c0-b991584a6826,network=Network(7593ddf6-1ad8-4498-9cbd-3ad9b77db488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88af3f7-eb') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb88af3f7-eb, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05f853ed-76a8-461c-a101-3491c64cd43c) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: INFO os_vif [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:22:c1,bridge_name='br-int',has_traffic_filtering=True,id=b88af3f7-eb48-47b2-84c0-b991584a6826,network=Network(7593ddf6-1ad8-4498-9cbd-3ad9b77db488),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb88af3f7-eb')
Nov 13 17:21:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnsZWvTg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:21 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c12baad-3db9-4caa-9c79-0ad1bddcc20f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:21:21 user nova-compute[75100]: No targets found.
Nov 13 17:21:21 user nova-compute[75100]: iSNS:
Nov 13 17:21:21 user nova-compute[75100]: No targets found.
Nov 13 17:21:21 user nova-compute[75100]: STATIC:
Nov 13 17:21:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10
Nov 13 17:21:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:21 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b
Nov 13 17:21:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:21 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163
Nov 13 17:21:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:21 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b
Nov 13 17:21:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:21 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d
Nov 13 17:21:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:21 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78
Nov 13 17:21:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:21 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:21 user nova-compute[75100]: FIRMWARE:
Nov 13 17:21:21 user nova-compute[75100]: No targets found.
Nov 13 17:21:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:21:21 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:21:21 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49454da-9f38-4627-9ea7-a43df912cde6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d74367f-f451-4b77-9c9e-99c6013c75b6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:21 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:21 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:21 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:21 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:21 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 (non-flash)
Nov 13 17:21:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:21 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:21 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:21 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:21 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:21 user nova-compute[75100]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 (non-flash)
Nov 13 17:21:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda7c223400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10'): ({'sdg'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Removing single pathed devices sdg {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6149869d-857c-451a-96b5-f7730e4a0b4c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b36078e-946d-4ee1-baa8-10ee235d26ad]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Flushing IO for device /dev/sdg {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ddced5-d419-4556-93ee-f4bc4b94b63f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.056s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a1a82f-f2fd-4a54-8a6a-dfa9c2694339]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9330fac4-b909-4493-aa46-afa2dd350a34]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae9570a-783c-4404-9206-a3853d6a8b0e]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10, portal: 172.16.0.220,3260]
Nov 13 17:21:21 user nova-compute[75100]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10, portal: 172.16.0.220,3260] successful.
Nov 13 17:21:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:21:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01c45f8c-4504-4320-b177-b7b20dc61f10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e99f76-d5f2-4800-abf4-9a7d54118c66]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] <== disconnect_volume: return (407ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:21:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Deleting instance files /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37_del
Nov 13 17:21:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Deletion of /opt/stack/data/nova/instances/31779592-a9f2-4aae-a658-e055ec832b37_del complete
Nov 13 17:21:22 user nova-compute[75100]: INFO nova.compute.manager [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:21:22 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Took 0.60 seconds to deallocate network for instance.
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-27c1b390-5021-4349-8e4f-23785373c4b4 req-75fc0065-b093-4fe0-93aa-040d7fc88b97 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Received event network-vif-deleted-b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-8d461e84-9b50-47ba-b728-034fc17aded1 req-b4a3d93e-c137-40c9-9e3b-c1865d8dee61 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Received event network-vif-plugged-b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8d461e84-9b50-47ba-b728-034fc17aded1 req-b4a3d93e-c137-40c9-9e3b-c1865d8dee61 service nova] Acquiring lock "31779592-a9f2-4aae-a658-e055ec832b37-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8d461e84-9b50-47ba-b728-034fc17aded1 req-b4a3d93e-c137-40c9-9e3b-c1865d8dee61 service nova] Lock "31779592-a9f2-4aae-a658-e055ec832b37-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8d461e84-9b50-47ba-b728-034fc17aded1 req-b4a3d93e-c137-40c9-9e3b-c1865d8dee61 service nova] Lock "31779592-a9f2-4aae-a658-e055ec832b37-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-8d461e84-9b50-47ba-b728-034fc17aded1 req-b4a3d93e-c137-40c9-9e3b-c1865d8dee61 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] No waiting events found dispatching network-vif-plugged-b88af3f7-eb48-47b2-84c0-b991584a6826 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:21:23 user nova-compute[75100]: WARNING nova.compute.manager [req-8d461e84-9b50-47ba-b728-034fc17aded1 req-b4a3d93e-c137-40c9-9e3b-c1865d8dee61 service nova] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Received unexpected event network-vif-plugged-b88af3f7-eb48-47b2-84c0-b991584a6826 for instance with vm_state active and task_state deleting.
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Snapshot image upload complete
Nov 13 17:21:23 user nova-compute[75100]: INFO nova.compute.manager [None req-ef27ff80-c28e-458c-9543-df44b3fe4f62 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Took 6.15 seconds to snapshot the instance on the hypervisor.
Nov 13 17:21:23 user nova-compute[75100]: INFO nova.compute.manager [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] [instance: 31779592-a9f2-4aae-a658-e055ec832b37] Took 0.79 seconds to detach 1 volumes for instance.
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:21:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:24 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Deleted allocations for instance 31779592-a9f2-4aae-a658-e055ec832b37
Nov 13 17:21:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b01a091c-174b-4200-9582-d326d54daf46 tempest-DeleteServersTestJSON-567642559 tempest-DeleteServersTestJSON-567642559-project-member] Lock "31779592-a9f2-4aae-a658-e055ec832b37" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.549s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:21:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=6741MB free_disk=25.447044372558594GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 64c9f78b-8ce5-4328-9fb0-93715df6135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7b8c5beb-5551-48b0-8331-bfcba175cc0e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 55c68a33-6003-4b98-a248-f5d3dafe77f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 5ead8372-787b-41f8-95cc-11dd49093606 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 2d03f2e7-200c-4cd7-bc65-088c34eeb17d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:21:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:21:25 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:21:25 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:21:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:21:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:21:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:21:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:21:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-680b3017-57c4-4d9b-81f8-778f62931561 req-fbf4612d-223b-43b0-9853-d508ecde4d3f service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Received event network-changed-17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-680b3017-57c4-4d9b-81f8-778f62931561 req-fbf4612d-223b-43b0-9853-d508ecde4d3f service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Refreshing instance network info cache due to event network-changed-17b414e0-be01-45df-9ae4-0a9be2c8b4cd. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-680b3017-57c4-4d9b-81f8-778f62931561 req-fbf4612d-223b-43b0-9853-d508ecde4d3f service nova] Acquiring lock "refresh_cache-d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-680b3017-57c4-4d9b-81f8-778f62931561 req-fbf4612d-223b-43b0-9853-d508ecde4d3f service nova] Acquired lock "refresh_cache-d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG nova.network.neutron [req-680b3017-57c4-4d9b-81f8-778f62931561 req-fbf4612d-223b-43b0-9853-d508ecde4d3f service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Refreshing network info cache for port 17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lazy-loading 'flavor' on Instance uuid d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:42 user nova-compute[75100]: INFO nova.compute.manager [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Attaching volume 601d32c1-ae7b-4e54-9a54-eeadfecf6d62 to /dev/vdb
Nov 13 17:21:42 user nova-compute[75100]: DEBUG os_brick.utils [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db675ab-7451-4a69-b960-89cd13a40301]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1956f2-6d47-4e64-93bf-1176504910d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba824ef-81ab-491e-a7d9-6e67b69c3a3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9b70f1-cc9e-4ee6-83da-ec182a13ae67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:21:42 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e33e249-7350-4331-8a19-09ade6e439ca]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG os_brick.utils [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Updating existing volume attachment record: 4252d4bf-bb03-4049-98a6-927617eeb655 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG nova.network.neutron [req-680b3017-57c4-4d9b-81f8-778f62931561 req-fbf4612d-223b-43b0-9853-d508ecde4d3f service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Updated VIF entry in instance network info cache for port 17b414e0-be01-45df-9ae4-0a9be2c8b4cd. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG nova.network.neutron [req-680b3017-57c4-4d9b-81f8-778f62931561 req-fbf4612d-223b-43b0-9853-d508ecde4d3f service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Updating instance_info_cache with network_info: [{"id": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "address": "fa:16:3e:3e:c6:e4", "network": {"id": "f70775c3-a96e-44f5-88b8-e6d63ee78d51", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257528124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f2a4991fba445f8c8092a7575c7480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17b414e0-be", "ovs_interfaceid": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:21:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-680b3017-57c4-4d9b-81f8-778f62931561 req-fbf4612d-223b-43b0-9853-d508ecde4d3f service nova] Releasing lock "refresh_cache-d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:21:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-9b500b15-9223-466b-95fb-1b0e4e89971a req-a3eaee9a-c5d6-4307-a951-0d3d3f63b424 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Received event network-changed-bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-9b500b15-9223-466b-95fb-1b0e4e89971a req-a3eaee9a-c5d6-4307-a951-0d3d3f63b424 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Refreshing instance network info cache due to event network-changed-bd9178d4-3984-4df2-8531-8dd8f4da4510. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:21:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9b500b15-9223-466b-95fb-1b0e4e89971a req-a3eaee9a-c5d6-4307-a951-0d3d3f63b424 service nova] Acquiring lock "refresh_cache-7b8c5beb-5551-48b0-8331-bfcba175cc0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:21:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9b500b15-9223-466b-95fb-1b0e4e89971a req-a3eaee9a-c5d6-4307-a951-0d3d3f63b424 service nova] Acquired lock "refresh_cache-7b8c5beb-5551-48b0-8331-bfcba175cc0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:21:43 user nova-compute[75100]: DEBUG nova.network.neutron [req-9b500b15-9223-466b-95fb-1b0e4e89971a req-a3eaee9a-c5d6-4307-a951-0d3d3f63b424 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Refreshing network info cache for port bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:21:43 user nova-compute[75100]: DEBUG nova.network.neutron [req-9b500b15-9223-466b-95fb-1b0e4e89971a req-a3eaee9a-c5d6-4307-a951-0d3d3f63b424 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Updated VIF entry in instance network info cache for port bd9178d4-3984-4df2-8531-8dd8f4da4510. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:21:43 user nova-compute[75100]: DEBUG nova.network.neutron [req-9b500b15-9223-466b-95fb-1b0e4e89971a req-a3eaee9a-c5d6-4307-a951-0d3d3f63b424 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Updating instance_info_cache with network_info: [{"id": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "address": "fa:16:3e:4b:75:c5", "network": {"id": "17f39e27-bb24-456e-9bb4-6db6772309b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-944565688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078f6299ef104b968a06e3e9cd6dd5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9178d4-39", "ovs_interfaceid": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:21:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9b500b15-9223-466b-95fb-1b0e4e89971a req-a3eaee9a-c5d6-4307-a951-0d3d3f63b424 service nova] Releasing lock "refresh_cache-7b8c5beb-5551-48b0-8331-bfcba175cc0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lazy-loading 'flavor' on Instance uuid 7b8c5beb-5551-48b0-8331-bfcba175cc0e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:45 user nova-compute[75100]: INFO nova.compute.manager [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Attaching volume bd454579-75ce-40cb-9a2c-407948da4ca2 to /dev/sdc
Nov 13 17:21:45 user nova-compute[75100]: DEBUG os_brick.utils [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1bfa13-8676-475b-b24f-657e207553a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62d2367-f870-48f2-a92d-db2a151692c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[032c4494-1fa2-46f4-9b7e-f0533ce6aa0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f371cf56-7b60-4617-8fb0-2b7cebe556dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:21:45 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:21:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f50707-178e-4f75-8b7a-9283cac249d0]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG os_brick.utils [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:45 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Updating existing volume attachment record: 90c86309-71f5-4f3e-ab79-aec507fae80f {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-d6879cba-e8b7-439f-8bdb-8a984f71be6d req-700a8bb4-7a58-4d45-b8af-9493267cfd47 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Received event network-changed-a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-d6879cba-e8b7-439f-8bdb-8a984f71be6d req-700a8bb4-7a58-4d45-b8af-9493267cfd47 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Refreshing instance network info cache due to event network-changed-a8348145-5a89-4365-ae02-deeb30863eae. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d6879cba-e8b7-439f-8bdb-8a984f71be6d req-700a8bb4-7a58-4d45-b8af-9493267cfd47 service nova] Acquiring lock "refresh_cache-55c68a33-6003-4b98-a248-f5d3dafe77f1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d6879cba-e8b7-439f-8bdb-8a984f71be6d req-700a8bb4-7a58-4d45-b8af-9493267cfd47 service nova] Acquired lock "refresh_cache-55c68a33-6003-4b98-a248-f5d3dafe77f1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-d6879cba-e8b7-439f-8bdb-8a984f71be6d req-700a8bb4-7a58-4d45-b8af-9493267cfd47 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Refreshing network info cache for port a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Acquiring lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lazy-loading 'flavor' on Instance uuid 55c68a33-6003-4b98-a248-f5d3dafe77f1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-d6879cba-e8b7-439f-8bdb-8a984f71be6d req-700a8bb4-7a58-4d45-b8af-9493267cfd47 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Updated VIF entry in instance network info cache for port a8348145-5a89-4365-ae02-deeb30863eae. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-d6879cba-e8b7-439f-8bdb-8a984f71be6d req-700a8bb4-7a58-4d45-b8af-9493267cfd47 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Updating instance_info_cache with network_info: [{"id": "a8348145-5a89-4365-ae02-deeb30863eae", "address": "fa:16:3e:ae:4f:f2", "network": {"id": "1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1383323174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633318b44b824f79a91e414700c3bc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8348145-5a", "ovs_interfaceid": "a8348145-5a89-4365-ae02-deeb30863eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d6879cba-e8b7-439f-8bdb-8a984f71be6d req-700a8bb4-7a58-4d45-b8af-9493267cfd47 service nova] Releasing lock "refresh_cache-55c68a33-6003-4b98-a248-f5d3dafe77f1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Acquiring lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:46 user nova-compute[75100]: INFO nova.compute.manager [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Attaching volume 3ce74a1b-16d6-4337-b3e9-7065fc5a1584 to /dev/vdb
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.utils [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb34c53b-3aaa-4af1-bcf5-adfeaedb28c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[908c4b29-d143-4a7b-b867-2c7ff74c5ee1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d10a226-ccc1-46e4-b30b-ab7c27736442]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0644d5b9-a739-4201-8958-63fbb29e94de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:21:46 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[451e7215-4c9b-429f-a822-a8a6378d515d]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.utils [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Updating existing volume attachment record: f3232be3-f6ae-4a11-822d-df988fd939af {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoixMywS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:46 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:46 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:46 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79c3a5a-f473-46db-928f-33122f933154]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:21:46 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[67279a4e-3bfb-40cb-8ec1-92fa46d26fbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62] added
Nov 13 17:21:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8440c6-73d2-42ad-8e31-d0a9c6a789cb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5a1a8e-0556-4329-9c3d-7e152f5c52fe]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BoixMywS {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BoixMywS" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef898140-24a6-452c-a9e0-500bf6971780]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BoixMywS'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[355e8905-e89d-4f14-ba3d-be49b4f7ecde]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88634fc-44c2-4ff1-9368-0b47249bf870]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b05ff82-b459-496d-98dc-440ffef9bbde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260]
Nov 13 17:21:47 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260] successful.
Nov 13 17:21:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[75393955-9971-4eda-9713-a449ce8447dc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bd6a73-68e0-4712-871c-a35705208219]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:47 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a83479-e027-47eb-b899-916a26e85658]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:21:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoixMywS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:21:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26336363564353432', 'path': '/dev/sdg'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336363564353432', 'path': '/dev/sdg'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:21:48 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lazy-loading 'flavor' on Instance uuid d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:21:48 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:21:48 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:21:48 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:21:48 user nova-compute[75100]:   <serial>601d32c1-ae7b-4e54-9a54-eeadfecf6d62</serial>
Nov 13 17:21:48 user nova-compute[75100]: </disk>
Nov 13 17:21:48 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:21:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:21:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:21:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] No VIF found with MAC fa:16:3e:3e:c6:e4, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:21:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c1db070-dcdf-4bc8-abfd-3751852380aa tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.206s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-4129e0ab-3ae0-484d-a5cc-8773e13443ff req-b8f155f3-8ac7-430a-b74f-a19ba41c001d service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-changed-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-4129e0ab-3ae0-484d-a5cc-8773e13443ff req-b8f155f3-8ac7-430a-b74f-a19ba41c001d service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Refreshing instance network info cache due to event network-changed-c364a290-68a0-4e5c-9865-a9b19620f0d1. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4129e0ab-3ae0-484d-a5cc-8773e13443ff req-b8f155f3-8ac7-430a-b74f-a19ba41c001d service nova] Acquiring lock "refresh_cache-5ead8372-787b-41f8-95cc-11dd49093606" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4129e0ab-3ae0-484d-a5cc-8773e13443ff req-b8f155f3-8ac7-430a-b74f-a19ba41c001d service nova] Acquired lock "refresh_cache-5ead8372-787b-41f8-95cc-11dd49093606" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG nova.network.neutron [req-4129e0ab-3ae0-484d-a5cc-8773e13443ff req-b8f155f3-8ac7-430a-b74f-a19ba41c001d service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Refreshing network info cache for port c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVmsKqyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:49 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:49 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:49 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bf3512-7406-4dce-ac8a-7928538d7fa9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:21:49 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13f24b4-814a-4fdc-9270-16ed4ae1cce9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2] added
Nov 13 17:21:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b0b4c7-7434-422e-9385-559773882e3b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG nova.network.neutron [req-4129e0ab-3ae0-484d-a5cc-8773e13443ff req-b8f155f3-8ac7-430a-b74f-a19ba41c001d service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Updated VIF entry in instance network info cache for port c364a290-68a0-4e5c-9865-a9b19620f0d1. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG nova.network.neutron [req-4129e0ab-3ae0-484d-a5cc-8773e13443ff req-b8f155f3-8ac7-430a-b74f-a19ba41c001d service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Updating instance_info_cache with network_info: [{"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1035f665-1803-47a1-834f-a77f73c32e56]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVmsKqyj {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4129e0ab-3ae0-484d-a5cc-8773e13443ff req-b8f155f3-8ac7-430a-b74f-a19ba41c001d service nova] Releasing lock "refresh_cache-5ead8372-787b-41f8-95cc-11dd49093606" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVmsKqyj" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6f873b-e3df-4897-b274-4d1e2b2fd9bd]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YVmsKqyj'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[601c6ddd-016f-4009-9722-48ef13abbeba]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77a12f1-5cc7-4e45-b620-c8d1d35e7c98]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Acquiring lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.utils [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d746f35-845d-497b-b61b-12d2bccb2c12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c57d89d-7eba-4141-906c-7715563945a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2, portal: 172.16.0.220,3260]
Nov 13 17:21:49 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2, portal: 172.16.0.220,3260] successful.
Nov 13 17:21:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7593d3b9-2040-4c9d-a562-313f2b82a902]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4bc69f-1f1e-4be2-83b4-53e2fdcf1ade]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d1e9eb-9bd7-484d-8d74-3d800ad3727b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d45f4a1-f6b1-4b95-9f03-aa0ac415328c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9f0e81-71a5-467d-9430-7714ad83fa4c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:21:50 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:21:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8c6da3-bd17-423b-a3dd-8e91811c6100]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG os_brick.utils [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acbf599-6799-40d1-a581-de47fb121947]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVmsKqyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:21:50 user nova-compute[75100]: INFO nova.compute.manager [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Swapping volume 601d32c1-ae7b-4e54-9a54-eeadfecf6d62 for 0f619716-2911-4802-8f9c-424cc1aa71ab
Nov 13 17:21:50 user nova-compute[75100]: INFO nova.compute.manager [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Rebuilding instance
Nov 13 17:21:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-a111516a-f71e-443e-a600-0e03db66b8fd req-476604ae-fda4-42cc-8d24-5e9055628469 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-unplugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a111516a-f71e-443e-a600-0e03db66b8fd req-476604ae-fda4-42cc-8d24-5e9055628469 service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a111516a-f71e-443e-a600-0e03db66b8fd req-476604ae-fda4-42cc-8d24-5e9055628469 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a111516a-f71e-443e-a600-0e03db66b8fd req-476604ae-fda4-42cc-8d24-5e9055628469 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-a111516a-f71e-443e-a600-0e03db66b8fd req-476604ae-fda4-42cc-8d24-5e9055628469 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] No waiting events found dispatching network-vif-unplugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:21:50 user nova-compute[75100]: WARNING nova.compute.manager [req-a111516a-f71e-443e-a600-0e03db66b8fd req-476604ae-fda4-42cc-8d24-5e9055628469 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received unexpected event network-vif-unplugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 for instance with vm_state active and task_state rebuilding.
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23337356362623337', 'path': '/dev/sdh'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337356362623337', 'path': '/dev/sdh'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lazy-loading 'flavor' on Instance uuid 7b8c5beb-5551-48b0-8331-bfcba175cc0e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:21:51 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:21:51 user nova-compute[75100]:   <source dev="/dev/sdh"/>
Nov 13 17:21:51 user nova-compute[75100]:   <target dev="sdc" bus="scsi"/>
Nov 13 17:21:51 user nova-compute[75100]:   <serial>bd454579-75ce-40cb-9a2c-407948da4ca2</serial>
Nov 13 17:21:51 user nova-compute[75100]:   <address type="drive" controller="0" unit="2"/>
Nov 13 17:21:51 user nova-compute[75100]: </disk>
Nov 13 17:21:51 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDibPuaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:51 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:51 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:51 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[888ea65a-03cc-4527-b9a3-b6b48e14a4a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:21:51 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bccdd3-448b-422b-9605-c7e4f88dc7dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584] added
Nov 13 17:21:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[07594801-3ea4-4b11-ac3c-31689129a01a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4c6d10-89d4-4f0a-aaab-f4e2092b00e6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZDibPuaA {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZDibPuaA" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9185d4-6857-488c-bf12-9c41afd5452d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZDibPuaA'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bafc902-6c61-4b5b-b130-e66fffc791b3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe656a9-d27c-4659-bc34-ed10d4ddcebf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e7a9b4-c1b0-4612-b935-f5c283c23af8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584, portal: 172.16.0.220,3260]
Nov 13 17:21:51 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584, portal: 172.16.0.220,3260] successful.
Nov 13 17:21:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceade1b-c412-47e5-b5a9-30df077537d2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[23716b50-83c0-4ff1-8370-3f39f319aaec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b68765d-b9da-4f2f-939f-d63d52e61905]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDibPuaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Instance destroyed successfully.
Nov 13 17:21:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Instance destroyed successfully.
Nov 13 17:21:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-434015320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-716596890',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMHrvy6dRXfrXCI4JiaUSDCttbmdw96JfvW+n8ZiGKpKZMjmLzpK9h3eR71xlPMzcT2ZyjL7UJxtt2DhdOyrObd8ECbbaG5NFmjMFIEU9X7Qc7cQ7GuxVyy0CTzRSvdWw==',key_name='tempest-keypair-203724816',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec5af88d50944bbd9e6ec2ae84f194d2',ramdisk_id='',reservation_id='r-yqh7vk1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1979706355',owner_user_name='tempest-ServerActionsV293TestJSON-1979706355-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:21:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f56979d0e374f6ea4be1920f5f62fd9',uuid=5ead8372-787b-41f8-95cc-11dd49093606,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Converting VIF {"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_vif [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc364a290-68, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0554aa76-ea69-4e58-9d8a-e713f2d50806) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:21:51 user nova-compute[75100]: INFO os_vif [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68')
Nov 13 17:21:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHOtjDqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:51 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 17:21:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] No BDM found with device name sda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] No VIF found with MAC fa:16:3e:4b:75:c5, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c1f84db7-fe7d-4bf7-b5b8-fb29c1f366b2 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.563s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26237333463636464', 'path': '/dev/sdi'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237333463636464', 'path': '/dev/sdi'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.872s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lazy-loading 'flavor' on Instance uuid 55c68a33-6003-4b98-a248-f5d3dafe77f1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac12c8b-7c7e-4167-9881-6ec8139a14cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:21:52 user nova-compute[75100]: No targets found.
Nov 13 17:21:52 user nova-compute[75100]: iSNS:
Nov 13 17:21:52 user nova-compute[75100]: No targets found.
Nov 13 17:21:52 user nova-compute[75100]: STATIC:
Nov 13 17:21:52 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:21:52 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:52 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:52 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b
Nov 13 17:21:52 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:52 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:52 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163
Nov 13 17:21:52 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:52 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:52 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2
Nov 13 17:21:52 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:52 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:52 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b
Nov 13 17:21:52 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:52 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:52 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584
Nov 13 17:21:52 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:52 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:52 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d
Nov 13 17:21:52 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:52 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:52 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78
Nov 13 17:21:52 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:52 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:52 user nova-compute[75100]: FIRMWARE:
Nov 13 17:21:52 user nova-compute[75100]: No targets found.
Nov 13 17:21:52 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:21:52 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:21:52 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] attach device xml: <disk type="block" device="disk">
Nov 13 17:21:52 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:21:52 user nova-compute[75100]:   <source dev="/dev/sdi"/>
Nov 13 17:21:52 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:21:52 user nova-compute[75100]:   <serial>3ce74a1b-16d6-4337-b3e9-7065fc5a1584</serial>
Nov 13 17:21:52 user nova-compute[75100]: </disk>
Nov 13 17:21:52 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[97117e05-8c63-4bd7-a6d9-f07ba797bf7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f80047-7066-45d3-b83e-331593bd847a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:52 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:52 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:52 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c4641f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd06766-2eb5-4f2f-9706-e1f6130c9b35]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7d31d7-e3ee-41d9-b6d0-199d2a7437bd]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5222fd-8ea8-47a5-a523-b46509d359e4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a449140-24e9-4b2e-b88d-010418deda82]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e7d33f3-cac9-4c5c-9be8-da4682dd801f req-ab3cb161-fc48-4b26-be63-f183e39963d4 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e7d33f3-cac9-4c5c-9be8-da4682dd801f req-ab3cb161-fc48-4b26-be63-f183e39963d4 service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e7d33f3-cac9-4c5c-9be8-da4682dd801f req-ab3cb161-fc48-4b26-be63-f183e39963d4 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6e7d33f3-cac9-4c5c-9be8-da4682dd801f req-ab3cb161-fc48-4b26-be63-f183e39963d4 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-6e7d33f3-cac9-4c5c-9be8-da4682dd801f req-ab3cb161-fc48-4b26-be63-f183e39963d4 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] No waiting events found dispatching network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:21:52 user nova-compute[75100]: WARNING nova.compute.manager [req-6e7d33f3-cac9-4c5c-9be8-da4682dd801f req-ab3cb161-fc48-4b26-be63-f183e39963d4 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received unexpected event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 for instance with vm_state active and task_state rebuilding.
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9be04d-14fc-42c7-a9c4-4ac5d873943f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9eef74-aa93-49a7-841b-7abbb941d4fd]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260]
Nov 13 17:21:52 user nova-compute[75100]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260] successful.
Nov 13 17:21:52 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad8480b-7afd-4013-856c-504a3d1b72a1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] <== disconnect_volume: return (1213ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:21:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Deleting instance files /opt/stack/data/nova/instances/5ead8372-787b-41f8-95cc-11dd49093606_del
Nov 13 17:21:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Deletion of /opt/stack/data/nova/instances/5ead8372-787b-41f8-95cc-11dd49093606_del complete
Nov 13 17:21:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:21:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] No VIF found with MAC fa:16:3e:ae:4f:f2, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:21:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 5ead8372-787b-41f8-95cc-11dd49093606 could not be found.
Nov 13 17:21:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHOtjDqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:53 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 17:21:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75dcc99-41c5-427b-a72a-9826b897341d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:21:53 user nova-compute[75100]: No targets found.
Nov 13 17:21:53 user nova-compute[75100]: iSNS:
Nov 13 17:21:53 user nova-compute[75100]: No targets found.
Nov 13 17:21:53 user nova-compute[75100]: STATIC:
Nov 13 17:21:53 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:21:53 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:53 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:53 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163
Nov 13 17:21:53 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:53 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:53 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2
Nov 13 17:21:53 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:53 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:53 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b
Nov 13 17:21:53 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:53 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:53 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584
Nov 13 17:21:53 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:53 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:53 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d
Nov 13 17:21:53 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:53 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:53 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78
Nov 13 17:21:53 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:53 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:53 user nova-compute[75100]: FIRMWARE:
Nov 13 17:21:53 user nova-compute[75100]: No targets found.
Nov 13 17:21:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:21:53 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:21:53 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4d97a880-976e-4966-8a90-10dd1fe79b5d tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.541s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2213c2-2594-4c57-abab-390cf72ae027]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebed351-725e-4577-9a39-9aed45024de8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:21:53 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:53 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:53 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:53 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:53 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:53 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:21:53 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:53 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:53 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:53 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:53 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:53 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c57a0e0>, {}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Disconnecting from: [] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] <== disconnect_volume: return (84ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:53 user nova-compute[75100]: INFO nova.compute.manager [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Detaching volume bd454579-75ce-40cb-9a2c-407948da4ca2
Nov 13 17:21:53 user nova-compute[75100]: INFO nova.virt.block_device [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Attempting to driver detach volume bd454579-75ce-40cb-9a2c-407948da4ca2 from mountpoint /dev/sdc
Nov 13 17:21:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Attempting to detach device sdc from instance 7b8c5beb-5551-48b0-8331-bfcba175cc0e from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:21:53 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:21:53 user nova-compute[75100]:   <source dev="/dev/sdh"/>
Nov 13 17:21:53 user nova-compute[75100]:   <target dev="sdc" bus="scsi"/>
Nov 13 17:21:53 user nova-compute[75100]:   <serial>bd454579-75ce-40cb-9a2c-407948da4ca2</serial>
Nov 13 17:21:53 user nova-compute[75100]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 13 17:21:53 user nova-compute[75100]: </disk>
Nov 13 17:21:53 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:21:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Successfully detached device sdc from instance 7b8c5beb-5551-48b0-8331-bfcba175cc0e from the persistent domain config.
Nov 13 17:21:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 7b8c5beb-5551-48b0-8331-bfcba175cc0e from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:21:53 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:21:53 user nova-compute[75100]:   <source dev="/dev/sdh"/>
Nov 13 17:21:53 user nova-compute[75100]:   <target dev="sdc" bus="scsi"/>
Nov 13 17:21:53 user nova-compute[75100]:   <serial>bd454579-75ce-40cb-9a2c-407948da4ca2</serial>
Nov 13 17:21:53 user nova-compute[75100]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 13 17:21:53 user nova-compute[75100]: </disk>
Nov 13 17:21:53 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:21:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 7b8c5beb-5551-48b0-8331-bfcba175cc0e {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Preparing to wait for external event volume-reimaged-c111e555-d452-4770-b8c7-853575a07b0b {{(pid=75100) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDIUWMRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd88fd6b4-8e19-4b0a-a6d4-761187cd3c0f', 'attached_at': '', 'detached_at': '', 'volume_id': '0f619716-2911-4802-8f9c-424cc1aa71ab', 'serial': '0f619716-2911-4802-8f9c-424cc1aa71ab'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoixMywS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'd88fd6b4-8e19-4b0a-a6d4-761187cd3c0f', 'attached_at': '', 'detached_at': '', 'volume_id': '601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'serial'} {{(pid=75100) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDIUWMRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:54 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:54 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:54 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf98b7ae-1958-42d1-8ead-8c155c9e702f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:21:54 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a685ecc-dbf8-47fc-9260-d765dce6e337]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab] added
Nov 13 17:21:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5c5810-1d31-492f-b242-80a8ccfd9ef0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-04efd30d-1936-49be-9296-f426a3a62f46 tempest-VolumesAssistedSnapshotsTest-785309121 tempest-VolumesAssistedSnapshotsTest-785309121-project] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] volume_snapshot_create: create_info: {'snapshot_id': 'f977a9c8-2165-4075-a119-cfb6ed40c49d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75100) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-04efd30d-1936-49be-9296-f426a3a62f46 tempest-VolumesAssistedSnapshotsTest-785309121 tempest-VolumesAssistedSnapshotsTest-785309121-project] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] snap xml: <domainsnapshot>
Nov 13 17:21:54 user nova-compute[75100]:   <disks>
Nov 13 17:21:54 user nova-compute[75100]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 13 17:21:54 user nova-compute[75100]:       <source file="/dev/new_file"/>
Nov 13 17:21:54 user nova-compute[75100]:     </disk>
Nov 13 17:21:54 user nova-compute[75100]:     <disk name="vda" snapshot="no"/>
Nov 13 17:21:54 user nova-compute[75100]:   </disks>
Nov 13 17:21:54 user nova-compute[75100]: </domainsnapshot>
Nov 13 17:21:54 user nova-compute[75100]:  {{(pid=75100) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG nova.objects.instance [None req-04efd30d-1936-49be-9296-f426a3a62f46 tempest-VolumesAssistedSnapshotsTest-785309121 tempest-VolumesAssistedSnapshotsTest-785309121-project] Lazy-loading 'system_metadata' on Instance uuid 55c68a33-6003-4b98-a248-f5d3dafe77f1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2276a29f-0797-4382-a0be-ddae18fcb7eb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fDIUWMRE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fDIUWMRE" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2036274c-8844-466f-a765-62de4a1e4e86]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fDIUWMRE'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-04efd30d-1936-49be-9296-f426a3a62f46 tempest-VolumesAssistedSnapshotsTest-785309121 tempest-VolumesAssistedSnapshotsTest-785309121-project] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5490f54-7ae3-4b00-8124-ac8981282d69]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [None req-04efd30d-1936-49be-9296-f426a3a62f46 tempest-VolumesAssistedSnapshotsTest-785309121 tempest-VolumesAssistedSnapshotsTest-785309121-project] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Traceback (most recent call last):
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     rv = execute(f, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     six.reraise(c, e, tb)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     raise value
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     rv = meth(*args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] 
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [None req-04efd30d-1936-49be-9296-f426a3a62f46 tempest-VolumesAssistedSnapshotsTest-785309121 tempest-VolumesAssistedSnapshotsTest-785309121-project] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Traceback (most recent call last):
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     self._volume_snapshot_create(context, instance, guest,
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     rv = execute(f, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     six.reraise(c, e, tb)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     raise value
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     rv = meth(*args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] 
Nov 13 17:21:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-eaac30a5-5e06-4509-90f2-ff4cee079a92 tempest-VolumesAssistedSnapshotsTest-785309121 tempest-VolumesAssistedSnapshotsTest-785309121-project] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] volume_snapshot_delete: delete_info: {'volume_id': '3ce74a1b-16d6-4337-b3e9-7065fc5a1584'} {{(pid=75100) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [None req-eaac30a5-5e06-4509-90f2-ff4cee079a92 tempest-VolumesAssistedSnapshotsTest-785309121 tempest-VolumesAssistedSnapshotsTest-785309121-project] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Traceback (most recent call last):
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1]     if delete_info['type'] != 'qcow2':
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] KeyError: 'type'
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] 
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc3615b-f73e-40c2-8fac-a5f7acabb5ac]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [None req-eaac30a5-5e06-4509-90f2-ff4cee079a92 tempest-VolumesAssistedSnapshotsTest-785309121 tempest-VolumesAssistedSnapshotsTest-785309121-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-4efda53f-d7f9-4d8c-b947-7d14e126db1c)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver [None req-04efd30d-1936-49be-9296-f426a3a62f46 tempest-VolumesAssistedSnapshotsTest-785309121 tempest-VolumesAssistedSnapshotsTest-785309121-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot f977a9c8-2165-4075-a119-cfb6ed40c49d could not be found.
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise value
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot f977a9c8-2165-4075-a119-cfb6ed40c49d could not be found. (HTTP 404) (Request-ID: req-b389a727-e9b1-464b-a9a4-877d7e267874)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot f977a9c8-2165-4075-a119-cfb6ed40c49d could not be found.
Nov 13 17:21:54 user nova-compute[75100]: ERROR nova.virt.libvirt.driver 
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server [None req-eaac30a5-5e06-4509-90f2-ff4cee079a92 tempest-VolumesAssistedSnapshotsTest-785309121 tempest-VolumesAssistedSnapshotsTest-785309121-project] Exception during message handling: KeyError: 'type'
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server 
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server [None req-04efd30d-1936-49be-9296-f426a3a62f46 tempest-VolumesAssistedSnapshotsTest-785309121 tempest-VolumesAssistedSnapshotsTest-785309121-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise value
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 17:21:54 user nova-compute[75100]: ERROR oslo_messaging.rpc.server 
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b00053-a863-412b-969c-44a7c21812a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab, portal: 172.16.0.220,3260]
Nov 13 17:21:54 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab, portal: 172.16.0.220,3260] successful.
Nov 13 17:21:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c02e84-7de8-4574-9982-6c3d62c1258a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89fb186-2954-4055-9f7a-3be8cc6586c0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fb4d6d-0252-4e0d-bb21-b8847383f940]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDIUWMRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Acquiring lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:54 user nova-compute[75100]: INFO nova.compute.manager [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Detaching volume 3ce74a1b-16d6-4337-b3e9-7065fc5a1584
Nov 13 17:21:54 user nova-compute[75100]: INFO nova.virt.block_device [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Attempting to driver detach volume 3ce74a1b-16d6-4337-b3e9-7065fc5a1584 from mountpoint /dev/vdb
Nov 13 17:21:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Attempting to detach device vdb from instance 55c68a33-6003-4b98-a248-f5d3dafe77f1 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] detach device xml: <disk type="block" device="disk">
Nov 13 17:21:54 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:21:54 user nova-compute[75100]:   <source dev="/dev/sdi"/>
Nov 13 17:21:54 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:21:54 user nova-compute[75100]:   <serial>3ce74a1b-16d6-4337-b3e9-7065fc5a1584</serial>
Nov 13 17:21:54 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:21:54 user nova-compute[75100]: </disk>
Nov 13 17:21:54 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:21:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Successfully detached device vdb from instance 55c68a33-6003-4b98-a248-f5d3dafe77f1 from the persistent domain config.
Nov 13 17:21:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55c68a33-6003-4b98-a248-f5d3dafe77f1 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:21:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] detach device xml: <disk type="block" device="disk">
Nov 13 17:21:54 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:21:54 user nova-compute[75100]:   <source dev="/dev/sdi"/>
Nov 13 17:21:54 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:21:54 user nova-compute[75100]:   <serial>3ce74a1b-16d6-4337-b3e9-7065fc5a1584</serial>
Nov 13 17:21:54 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:21:54 user nova-compute[75100]: </disk>
Nov 13 17:21:54 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:21:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55c68a33-6003-4b98-a248-f5d3dafe77f1 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:21:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26665383536653231', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665383536653231', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:21:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lazy-loading 'flavor' on Instance uuid d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:21:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 150994944 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:21:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 309329920 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:21:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 493879296 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:21:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:57 user nova-compute[75100]: INFO nova.compute.manager [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Terminating instance
Nov 13 17:21:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:21:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 632291328 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-a50662c0-a2e4-487d-b450-bd48ecbb41b9 req-4d60d1b5-1787-451b-b1c8-e4e2bb9f5566 service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Received event network-vif-unplugged-3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a50662c0-a2e4-487d-b450-bd48ecbb41b9 req-4d60d1b5-1787-451b-b1c8-e4e2bb9f5566 service nova] Acquiring lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a50662c0-a2e4-487d-b450-bd48ecbb41b9 req-4d60d1b5-1787-451b-b1c8-e4e2bb9f5566 service nova] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a50662c0-a2e4-487d-b450-bd48ecbb41b9 req-4d60d1b5-1787-451b-b1c8-e4e2bb9f5566 service nova] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-a50662c0-a2e4-487d-b450-bd48ecbb41b9 req-4d60d1b5-1787-451b-b1c8-e4e2bb9f5566 service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] No waiting events found dispatching network-vif-unplugged-3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-a50662c0-a2e4-487d-b450-bd48ecbb41b9 req-4d60d1b5-1787-451b-b1c8-e4e2bb9f5566 service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Received event network-vif-unplugged-3d12ce3b-464f-4825-affd-2ea22cf6065a for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 758120448 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:21:58 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Instance destroyed successfully.
Nov 13 17:21:58 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lazy-loading 'resources' on Instance uuid 2d03f2e7-200c-4cd7-bc65-088c34eeb17d {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:20:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-509358659',display_name='tempest-TestVolumeBootPattern-server-509358659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-509358659',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-f0jp3mpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:20:26Z,user_data=None,user_id='421484d1f180498fa5e078c084d70986',uuid=2d03f2e7-200c-4cd7-bc65-088c34eeb17d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "address": "fa:16:3e:5e:25:16", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d12ce3b-46", "ovs_interfaceid": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "address": "fa:16:3e:5e:25:16", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d12ce3b-46", "ovs_interfaceid": "3d12ce3b-464f-4825-affd-2ea22cf6065a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:25:16,bridge_name='br-int',has_traffic_filtering=True,id=3d12ce3b-464f-4825-affd-2ea22cf6065a,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d12ce3b-46') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_vif [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:25:16,bridge_name='br-int',has_traffic_filtering=True,id=3d12ce3b-464f-4825-affd-2ea22cf6065a,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d12ce3b-46') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d12ce3b-46, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c1f06f9-245d-45ff-8fc0-b38a6e7a11dc) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:21:58 user nova-compute[75100]: INFO os_vif [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:25:16,bridge_name='br-int',has_traffic_filtering=True,id=3d12ce3b-464f-4825-affd-2ea22cf6065a,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d12ce3b-46')
Nov 13 17:21:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDnOPhEr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:21:58 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[483e4f81-ef86-4a80-b081-dab28656c408]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:21:58 user nova-compute[75100]: No targets found.
Nov 13 17:21:58 user nova-compute[75100]: iSNS:
Nov 13 17:21:58 user nova-compute[75100]: No targets found.
Nov 13 17:21:58 user nova-compute[75100]: STATIC:
Nov 13 17:21:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:21:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163
Nov 13 17:21:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2
Nov 13 17:21:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab
Nov 13 17:21:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b
Nov 13 17:21:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584
Nov 13 17:21:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d
Nov 13 17:21:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78
Nov 13 17:21:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:21:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:21:58 user nova-compute[75100]: FIRMWARE:
Nov 13 17:21:58 user nova-compute[75100]: No targets found.
Nov 13 17:21:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:21:58 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:21:58 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb81d94-2419-4337-9d28-a8ed0b8693b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2df490-ded7-47f4-9964-cd46ffb46736]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:21:58 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:21:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda88e29510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abe40e0-2309-4d74-bb1f-e572fe83609f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb38a3c1-7a03-47d0-b5cb-b53e028dbae1]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[db325e4f-1348-4c79-8ecb-20ff4a8d5d02]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:21:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4132c3-ab8a-4c57-9cda-81c242e7e912]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23361613432373937', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1a2815d6', '/dev/disk/by-id/scsi-1SCST_BIO1a2815d6-3aa42797ec766550') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd42e3c-cb41-457e-820e-d27db1210eb5]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[66040e9a-fdf0-428f-92d8-a99b94098280]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 849346560 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98a92ce-3083-4eaf-a57a-a33d3fb46a6a]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b, portal: 172.16.0.220,3260]
Nov 13 17:21:59 user nova-compute[75100]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b, portal: 172.16.0.220,3260] successful.
Nov 13 17:21:59 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d400dc09-e63b-404a-9c6f-4fc1eddb990b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[809b2ab5-a766-45cf-9f77-869900d2bdce]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== disconnect_volume: return (386ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:21:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Deleting instance files /opt/stack/data/nova/instances/2d03f2e7-200c-4cd7-bc65-088c34eeb17d_del
Nov 13 17:21:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Deletion of /opt/stack/data/nova/instances/2d03f2e7-200c-4cd7-bc65-088c34eeb17d_del complete
Nov 13 17:21:59 user nova-compute[75100]: INFO nova.compute.manager [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Took 1.51 seconds to destroy the instance on the hypervisor.
Nov 13 17:21:59 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 1020264448 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:21:59 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:21:59 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Took 0.60 seconds to deallocate network for instance.
Nov 13 17:22:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-c87a0523-d8ec-491b-9b69-223add763e92 req-0ce34e1c-275d-4fff-a0fb-3c2ed4534560 service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Received event network-vif-plugged-3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c87a0523-d8ec-491b-9b69-223add763e92 req-0ce34e1c-275d-4fff-a0fb-3c2ed4534560 service nova] Acquiring lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c87a0523-d8ec-491b-9b69-223add763e92 req-0ce34e1c-275d-4fff-a0fb-3c2ed4534560 service nova] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c87a0523-d8ec-491b-9b69-223add763e92 req-0ce34e1c-275d-4fff-a0fb-3c2ed4534560 service nova] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-c87a0523-d8ec-491b-9b69-223add763e92 req-0ce34e1c-275d-4fff-a0fb-3c2ed4534560 service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] No waiting events found dispatching network-vif-plugged-3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:00 user nova-compute[75100]: WARNING nova.compute.manager [req-c87a0523-d8ec-491b-9b69-223add763e92 req-0ce34e1c-275d-4fff-a0fb-3c2ed4534560 service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Received unexpected event network-vif-plugged-3d12ce3b-464f-4825-affd-2ea22cf6065a for instance with vm_state active and task_state deleting.
Nov 13 17:22:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-c87a0523-d8ec-491b-9b69-223add763e92 req-0ce34e1c-275d-4fff-a0fb-3c2ed4534560 service nova] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Received event network-vif-deleted-3d12ce3b-464f-4825-affd-2ea22cf6065a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoixMywS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:00 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2388979-8f22-4aaa-8bc8-9dc581188b87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:22:00 user nova-compute[75100]: No targets found.
Nov 13 17:22:00 user nova-compute[75100]: iSNS:
Nov 13 17:22:00 user nova-compute[75100]: No targets found.
Nov 13 17:22:00 user nova-compute[75100]: STATIC:
Nov 13 17:22:00 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:22:00 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:00 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:00 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b
Nov 13 17:22:00 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:00 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:00 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163
Nov 13 17:22:00 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:00 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:00 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2
Nov 13 17:22:00 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:00 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:00 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab
Nov 13 17:22:00 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:00 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:00 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584
Nov 13 17:22:00 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:00 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:00 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d
Nov 13 17:22:00 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:00 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:00 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78
Nov 13 17:22:00 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:00 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:00 user nova-compute[75100]: FIRMWARE:
Nov 13 17:22:00 user nova-compute[75100]: No targets found.
Nov 13 17:22:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:22:00 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:22:00 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d9fabc-1531-4ace-bfeb-ddc4035ea830]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e980123-1ebe-498a-a8f7-d818c950f308]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:00 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:00 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:22:00 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:22:00 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:22:00 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:00 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:00 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:00 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:22:00 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:22:00 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:22:00 user nova-compute[75100]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:00 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38eee320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62'): ({'sdg'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Removing single pathed devices sdg {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89709f2-0d8d-4d13-be77-0ecc8061ac6a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed4c963-f5be-4d3a-b5e9-9f4410a4d622]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Flushing IO for device /dev/sdg {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc3ae7c-df2a-41ce-9242-0644e76850fc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccfce1c-e372-4568-a22f-701b1063be62]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[688177b2-1d18-42c2-9330-f77a26a9fedc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba4449b-350d-49fb-be03-04f84d23b8ae]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260]
Nov 13 17:22:00 user nova-compute[75100]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260] successful.
Nov 13 17:22:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:00 user nova-compute[75100]: INFO nova.compute.manager [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Took 0.81 seconds to detach 1 volumes for instance.
Nov 13 17:22:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 2d03f2e7-200c-4cd7-bc65-088c34eeb17d] Deleting volume: d400dc09-e63b-404a-9c6f-4fc1eddb990b {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bb117e-ac1b-4a8a-ac93-14b8d24008e5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] <== disconnect_volume: return (385ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDIUWMRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd88fd6b4-8e19-4b0a-a6d4-761187cd3c0f', 'attached_at': '', 'detached_at': '', 'volume_id': '0f619716-2911-4802-8f9c-424cc1aa71ab', 'serial'} {{(pid=75100) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] swap_volume: removing Cinder connection for volume 601d32c1-ae7b-4e54-9a54-eeadfecf6d62 {{(pid=75100) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:01 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:22:01 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:22:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:01 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Deleted allocations for instance 2d03f2e7-200c-4cd7-bc65-088c34eeb17d
Nov 13 17:22:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0ce9fcb9-77bb-4381-885e-9148176cd554 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "2d03f2e7-200c-4cd7-bc65-088c34eeb17d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.677s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] swap_volume: Updating volume 601d32c1-ae7b-4e54-9a54-eeadfecf6d62 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "fDIUWMRE", "auth_password": "f3z65EvJnRuIpS", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "0f619716-2911-4802-8f9c-424cc1aa71ab"}, "status": "reserved", "instance": "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f", "attached_at": "", "detached_at": "", "volume_id": "0f619716-2911-4802-8f9c-424cc1aa71ab", "serial": "0f619716-2911-4802-8f9c-424cc1aa71ab"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0f619716-2911-4802-8f9c-424cc1aa71ab', 'no_device': None, 'attachment_id': '33a31335-8ee1-4b87-9368-50b565353a18'} {{(pid=75100) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 13 17:22:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-510bd5bd-4099-43ce-8373-0951281583d5 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.783s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Acquiring lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG os_brick.utils [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[efba7405-2250-47ef-94b4-98b499458273]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c0a824-1ab1-4cad-96f3-f5899b74c983]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[73882738-a464-4198-a079-abab6264a50e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1aad6a-da69-42ca-89d4-87ee7ac0b825]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:22:02 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:22:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82c43c2-4943-438a-9f8e-d232b9aeea13]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:22:02 user nova-compute[75100]: DEBUG os_brick.utils [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:02 user nova-compute[75100]: INFO nova.compute.manager [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Swapping volume 0f619716-2911-4802-8f9c-424cc1aa71ab for 601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:22:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-57a55b70-1ea0-4713-85b5-f6da56d1a6c3 req-a73e139e-e97a-40d4-b988-450db93c82d6 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-changed-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-57a55b70-1ea0-4713-85b5-f6da56d1a6c3 req-a73e139e-e97a-40d4-b988-450db93c82d6 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing instance network info cache due to event network-changed-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:22:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57a55b70-1ea0-4713-85b5-f6da56d1a6c3 req-a73e139e-e97a-40d4-b988-450db93c82d6 service nova] Acquiring lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:22:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57a55b70-1ea0-4713-85b5-f6da56d1a6c3 req-a73e139e-e97a-40d4-b988-450db93c82d6 service nova] Acquired lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:22:05 user nova-compute[75100]: DEBUG nova.network.neutron [req-57a55b70-1ea0-4713-85b5-f6da56d1a6c3 req-a73e139e-e97a-40d4-b988-450db93c82d6 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Refreshing network info cache for port 8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:22:06 user nova-compute[75100]: DEBUG nova.network.neutron [req-57a55b70-1ea0-4713-85b5-f6da56d1a6c3 req-a73e139e-e97a-40d4-b988-450db93c82d6 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updated VIF entry in instance network info cache for port 8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:22:06 user nova-compute[75100]: DEBUG nova.network.neutron [req-57a55b70-1ea0-4713-85b5-f6da56d1a6c3 req-a73e139e-e97a-40d4-b988-450db93c82d6 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [{"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "address": "fa:16:3e:71:c2:19", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8660440-37", "ovs_interfaceid": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:22:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57a55b70-1ea0-4713-85b5-f6da56d1a6c3 req-a73e139e-e97a-40d4-b988-450db93c82d6 service nova] Releasing lock "refresh_cache-f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:22:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoixMywS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd88fd6b4-8e19-4b0a-a6d4-761187cd3c0f', 'attached_at': '', 'detached_at': '', 'volume_id': '601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'serial': '601d32c1-ae7b-4e54-9a54-eeadfecf6d62'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDIUWMRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '0f619716-2911-4802-8f9c-424cc1aa71ab'}, 'status': 'reserved', 'instance': 'd88fd6b4-8e19-4b0a-a6d4-761187cd3c0f', 'attached_at': '', 'detached_at': '', 'volume_id': '0f619716-2911-4802-8f9c-424cc1aa71ab', 'serial'} {{(pid=75100) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoixMywS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:07 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:07 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:07 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d7ce5d-2d47-4569-93a7-8ad5fdb63dc3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:22:07 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9348722b-51e8-4cf5-8af3-168e61415345]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62] added
Nov 13 17:22:07 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc14b3b-94ec-4853-9cae-fa195ff67c98]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ec29a1-8ea9-4bc7-b961-39ef194d6067]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BoixMywS {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BoixMywS" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[474bacde-688e-4211-8210-ae03d0bff282]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BoixMywS'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafeae68-b5c1-470f-9654-672296cd7958]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcd4f97-c39a-45a6-858c-08d68e8c5c54]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[132e98f8-ad66-4aed-8d2e-e9a17fc76c0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260]
Nov 13 17:22:07 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260] successful.
Nov 13 17:22:07 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1dbaf9-cc74-47b8-8477-1b3bc91d632c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[205a9b53-4f24-4a11-86bb-0abdb41e43b6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:07 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde17197-b80e-48fa-8051-eb08921b881d]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:22:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoixMywS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:08 user nova-compute[75100]: INFO nova.compute.manager [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Terminating instance
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-8794e85c-2bae-461b-b960-ce717745b4bd req-90379e84-a10b-4148-a175-d4fd07a55275 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event volume-reimaged-c111e555-d452-4770-b8c7-853575a07b0b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8794e85c-2bae-461b-b960-ce717745b4bd req-90379e84-a10b-4148-a175-d4fd07a55275 service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8794e85c-2bae-461b-b960-ce717745b4bd req-90379e84-a10b-4148-a175-d4fd07a55275 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8794e85c-2bae-461b-b960-ce717745b4bd req-90379e84-a10b-4148-a175-d4fd07a55275 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-8794e85c-2bae-461b-b960-ce717745b4bd req-90379e84-a10b-4148-a175-d4fd07a55275 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Processing event volume-reimaged-c111e555-d452-4770-b8c7-853575a07b0b {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-998928b1-4151-4daf-be57-2836e13b802b req-82d73813-5f42-4404-95b4-2a13ffbfbe49 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-998928b1-4151-4daf-be57-2836e13b802b req-82d73813-5f42-4404-95b4-2a13ffbfbe49 service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-998928b1-4151-4daf-be57-2836e13b802b req-82d73813-5f42-4404-95b4-2a13ffbfbe49 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-998928b1-4151-4daf-be57-2836e13b802b req-82d73813-5f42-4404-95b4-2a13ffbfbe49 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-998928b1-4151-4daf-be57-2836e13b802b req-82d73813-5f42-4404-95b4-2a13ffbfbe49 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-unplugged-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-998928b1-4151-4daf-be57-2836e13b802b req-82d73813-5f42-4404-95b4-2a13ffbfbe49 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: INFO nova.virt.block_device [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Booting with volume c111e555-d452-4770-b8c7-853575a07b0b at /dev/vda
Nov 13 17:22:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26336363564353432', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336363564353432', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-d89f4c30-5f08-407e-bd7d-b066cb03ea05 req-7954e4b0-7fe2-4ed6-8bd2-a69604504d8d service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d89f4c30-5f08-407e-bd7d-b066cb03ea05 req-7954e4b0-7fe2-4ed6-8bd2-a69604504d8d service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d89f4c30-5f08-407e-bd7d-b066cb03ea05 req-7954e4b0-7fe2-4ed6-8bd2-a69604504d8d service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d89f4c30-5f08-407e-bd7d-b066cb03ea05 req-7954e4b0-7fe2-4ed6-8bd2-a69604504d8d service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-d89f4c30-5f08-407e-bd7d-b066cb03ea05 req-7954e4b0-7fe2-4ed6-8bd2-a69604504d8d service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-unplugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-d89f4c30-5f08-407e-bd7d-b066cb03ea05 req-7954e4b0-7fe2-4ed6-8bd2-a69604504d8d service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-a020143e-a824-46fb-8988-9de41419b4cc for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.objects.instance [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lazy-loading 'flavor' on Instance uuid d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG os_brick.utils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd08b36-e913-4eda-81d5-4cde2eaf1110]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e83600-959f-4fc7-a5b2-99180246c3c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3cb526-3437-48a1-a335-ed1defc7ee29]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0dd953-9cea-4569-bf3a-6c6b4ee12cc7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:22:08 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:22:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[be58953c-5274-4672-90f4-419ca8510ea9]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG os_brick.utils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Updating existing volume attachment record: b4db64c4-f5f2-4892-ba06-ef2f047d7300 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-2cc432ba-06ff-4fdd-8ba7-86fc51f828ab req-9dbe9ea5-3412-4904-adaa-10cb9e661239 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2cc432ba-06ff-4fdd-8ba7-86fc51f828ab req-9dbe9ea5-3412-4904-adaa-10cb9e661239 service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2cc432ba-06ff-4fdd-8ba7-86fc51f828ab req-9dbe9ea5-3412-4904-adaa-10cb9e661239 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2cc432ba-06ff-4fdd-8ba7-86fc51f828ab req-9dbe9ea5-3412-4904-adaa-10cb9e661239 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-2cc432ba-06ff-4fdd-8ba7-86fc51f828ab req-9dbe9ea5-3412-4904-adaa-10cb9e661239 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-unplugged-b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-2cc432ba-06ff-4fdd-8ba7-86fc51f828ab req-9dbe9ea5-3412-4904-adaa-10cb9e661239 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-b401007f-7e49-4a6e-9ac9-1da782cfea31 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 135266304 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:09 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Instance destroyed successfully.
Nov 13 17:22:09 user nova-compute[75100]: DEBUG nova.objects.instance [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lazy-loading 'resources' on Instance uuid f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:bc:c8,bridge_name='br-int',has_traffic_filtering=True,id=8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340,network=Network(5bf875da-58d1-4ba4-8e2a-6cca9e5199ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9c51ce-9d') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:bc:c8,bridge_name='br-int',has_traffic_filtering=True,id=8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340,network=Network(5bf875da-58d1-4ba4-8e2a-6cca9e5199ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9c51ce-9d') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d9c51ce-9d, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 293601280 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fce72674-8b9a-4d14-be10-66abb180f2ed) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: INFO os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:bc:c8,bridge_name='br-int',has_traffic_filtering=True,id=8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340,network=Network(5bf875da-58d1-4ba4-8e2a-6cca9e5199ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9c51ce-9d')
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=a020143e-a824-46fb-8988-9de41419b4cc,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa020143e-a8') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=a020143e-a824-46fb-8988-9de41419b4cc,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa020143e-a8') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa020143e-a8, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4798c8a-21ce-4c9b-a63e-239104af286d) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-2c6d8796-38a4-4cf5-adb8-de680e90e09b req-574542af-6099-4b62-ab73-3a1e4a80e289 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2c6d8796-38a4-4cf5-adb8-de680e90e09b req-574542af-6099-4b62-ab73-3a1e4a80e289 service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2c6d8796-38a4-4cf5-adb8-de680e90e09b req-574542af-6099-4b62-ab73-3a1e4a80e289 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2c6d8796-38a4-4cf5-adb8-de680e90e09b req-574542af-6099-4b62-ab73-3a1e4a80e289 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-2c6d8796-38a4-4cf5-adb8-de680e90e09b req-574542af-6099-4b62-ab73-3a1e4a80e289 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:10 user nova-compute[75100]: WARNING nova.compute.manager [req-2c6d8796-38a4-4cf5-adb8-de680e90e09b req-574542af-6099-4b62-ab73-3a1e4a80e289 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 for instance with vm_state active and task_state deleting.
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: INFO os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:aa:32,bridge_name='br-int',has_traffic_filtering=True,id=a020143e-a824-46fb-8988-9de41419b4cc,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa020143e-a8')
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f2:c7,bridge_name='br-int',has_traffic_filtering=True,id=6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c1300f5-b3') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f2:c7,bridge_name='br-int',has_traffic_filtering=True,id=6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c1300f5-b3') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c1300f5-b3, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:10 user nova-compute[75100]: WARNING nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc for instance with vm_state active and task_state deleting.
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-unplugged-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:10 user nova-compute[75100]: WARNING nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a for instance with vm_state active and task_state deleting.
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-unplugged-c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-c69ece98-a175-4524-b5b6-acf4d6804db7 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:10 user nova-compute[75100]: WARNING nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-c69ece98-a175-4524-b5b6-acf4d6804db7 for instance with vm_state active and task_state deleting.
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:10 user nova-compute[75100]: WARNING nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc for instance with vm_state active and task_state deleting.
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:10 user nova-compute[75100]: WARNING nova.compute.manager [req-3705a73a-dcb9-498e-8166-63acb1138db2 req-e09e5f72-818b-4166-81be-be2fcfcb8b9f service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc for instance with vm_state active and task_state deleting.
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ba98148-02fd-4c21-b2df-2cda0bc11e23) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 475004928 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: INFO os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:f2:c7,bridge_name='br-int',has_traffic_filtering=True,id=6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6c1300f5-b3')
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:dd:6b,bridge_name='br-int',has_traffic_filtering=True,id=c69ece98-a175-4524-b5b6-acf4d6804db7,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69ece98-a1') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:dd:6b,bridge_name='br-int',has_traffic_filtering=True,id=c69ece98-a175-4524-b5b6-acf4d6804db7,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69ece98-a1') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc69ece98-a1, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5002fcf-08fc-4150-9e1f-08e7ffbab4e0) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: INFO os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:dd:6b,bridge_name='br-int',has_traffic_filtering=True,id=c69ece98-a175-4524-b5b6-acf4d6804db7,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc69ece98-a1')
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6b:dc,bridge_name='br-int',has_traffic_filtering=True,id=b401007f-7e49-4a6e-9ac9-1da782cfea31,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb401007f-7e') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6b:dc,bridge_name='br-int',has_traffic_filtering=True,id=b401007f-7e49-4a6e-9ac9-1da782cfea31,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb401007f-7e') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb401007f-7e, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c1023ab-5360-4ed2-9371-7b3fafcf64fb) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: INFO os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:6b:dc,bridge_name='br-int',has_traffic_filtering=True,id=b401007f-7e49-4a6e-9ac9-1da782cfea31,network=Network(3f7ab502-887f-411a-96dd-744f5f3af3b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb401007f-7e')
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=f74a46ed-40fb-40ab-ad63-74b69ab3a6ef,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74a46ed-40') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=f74a46ed-40fb-40ab-ad63-74b69ab3a6ef,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74a46ed-40') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf74a46ed-40, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d7063d4-a24f-40dc-ab66-0e1a5e6b535f) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:11 user nova-compute[75100]: INFO os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=f74a46ed-40fb-40ab-ad63-74b69ab3a6ef,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf74a46ed-40')
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-166150551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-166150551',id=12,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVYOEcvQQA733iPEnDbK2Vmmg6f7gX+qPrJTVoiXSdwlm+/hn6HhUWX9VI79SuBfNU9cZ1lddNkq2iSOmUEvMlwEqdNvScwzQGm31pmulqUhNZEZ4q5n81tlGVUxqjzoA==',key_name='tempest-keypair-1003546804',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04e7fe01efa34fc489341a2429a5c754',ramdisk_id='',reservation_id='r-b7tn48d2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-921800196',owner_user_name='tempest-TaggedBootDevicesTest-921800196-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f05b94b0123546e3bd9324f9806edbca',uuid=f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "address": "fa:16:3e:71:c2:19", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8660440-37", "ovs_interfaceid": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converting VIF {"id": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "address": "fa:16:3e:71:c2:19", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8660440-37", "ovs_interfaceid": "e8660440-37a5-4e0e-a0cd-99ab02aaa577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c2:19,bridge_name='br-int',has_traffic_filtering=True,id=e8660440-37a5-4e0e-a0cd-99ab02aaa577,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8660440-37') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c2:19,bridge_name='br-int',has_traffic_filtering=True,id=e8660440-37a5-4e0e-a0cd-99ab02aaa577,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8660440-37') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8660440-37, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aba0eeb2-2425-4ffe-9717-bf329fd1330d) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:11 user nova-compute[75100]: INFO os_vif [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c2:19,bridge_name='br-int',has_traffic_filtering=True,id=e8660440-37a5-4e0e-a0cd-99ab02aaa577,network=Network(d6c43b9a-3d3a-4f3e-9344-f00d65844989),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8660440-37')
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LxbgTPrQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:11 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:11 user nova-compute[75100]: WARNING nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-b401007f-7e49-4a6e-9ac9-1da782cfea31 for instance with vm_state active and task_state deleting.
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-unplugged-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:11 user nova-compute[75100]: WARNING nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef for instance with vm_state active and task_state deleting.
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-unplugged-e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-e8660440-37a5-4e0e-a0cd-99ab02aaa577 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:11 user nova-compute[75100]: WARNING nova.compute.manager [req-8231b469-6681-48f9-9151-cb4bd6982fb8 req-b538e525-cdfd-48a8-8070-e4dc88122912 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-e8660440-37a5-4e0e-a0cd-99ab02aaa577 for instance with vm_state active and task_state deleting.
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f15040-c171-4cdb-b813-3f151231b748]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:22:11 user nova-compute[75100]: No targets found.
Nov 13 17:22:11 user nova-compute[75100]: iSNS:
Nov 13 17:22:11 user nova-compute[75100]: No targets found.
Nov 13 17:22:11 user nova-compute[75100]: STATIC:
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: FIRMWARE:
Nov 13 17:22:11 user nova-compute[75100]: No targets found.
Nov 13 17:22:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:22:11 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:22:11 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 611319808 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1104640d-b493-46f8-be8c-783c004520f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3753e5-c19e-4075-b4b0-f99436e3d355]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c4c0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe892d95-bfc5-427e-a6b2-5ae5dff6d947]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5459685b-6022-40c0-9a7e-6736264e3d31]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd74807-9cd9-49bd-a2e9-4376712f60e1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c35af80-9140-4d9a-b888-693021a4d234]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b073928e-b961-454a-9253-14e9ac1aad10]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[69df1e37-25f4-4a2f-970d-e1dc6b78b9f6]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d, portal: 172.16.0.220,3260]
Nov 13 17:22:11 user nova-compute[75100]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d, portal: 172.16.0.220,3260] successful.
Nov 13 17:22:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ddab20d-ea6e-468d-be6d-6c9a28b3141d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b109b1f-1a07-4522-bba4-800647f584ff]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] <== disconnect_volume: return (434ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFBHPDNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:11 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[12695072-6f10-4ae9-b016-a26007dbd9db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:22:11 user nova-compute[75100]: No targets found.
Nov 13 17:22:11 user nova-compute[75100]: iSNS:
Nov 13 17:22:11 user nova-compute[75100]: No targets found.
Nov 13 17:22:11 user nova-compute[75100]: STATIC:
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: FIRMWARE:
Nov 13 17:22:11 user nova-compute[75100]: No targets found.
Nov 13 17:22:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:22:11 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:22:11 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[357006ef-d6eb-4654-a507-a6ae56b8c77f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[901e7a95-3371-4ff0-92b9-d9dacefbfd3e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c4c0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 784334848 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c73388-03ad-4078-872c-854fa97c1b7a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6949eaa3-66aa-474a-be63-7bc6520c8ec4]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b22c5b4-a594-4c43-bff6-cced096a6653]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f042b82-48a5-44c6-b9eb-9fbbfd96e231]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[451e684b-3dc4-48b1-9dd5-a8cbe36d3609]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d6a297-cf92-4c45-8db8-d404ae9ea3e5]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78, portal: 172.16.0.220,3260]
Nov 13 17:22:11 user nova-compute[75100]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78, portal: 172.16.0.220,3260] successful.
Nov 13 17:22:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd07af02-c0eb-4bf2-a9fe-f54ac43f4d78 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b1c55f-d7dd-42b7-8626-8d668632b10a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] <== disconnect_volume: return (411ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdqvuVPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:11 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3538295c-7b4c-47a7-a24f-7113dfde42db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:22:11 user nova-compute[75100]: No targets found.
Nov 13 17:22:11 user nova-compute[75100]: iSNS:
Nov 13 17:22:11 user nova-compute[75100]: No targets found.
Nov 13 17:22:11 user nova-compute[75100]: STATIC:
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584
Nov 13 17:22:11 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:11 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:11 user nova-compute[75100]: FIRMWARE:
Nov 13 17:22:11 user nova-compute[75100]: No targets found.
Nov 13 17:22:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:22:12 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:22:12 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2644826-2472-45dd-834c-ccf1caf88e77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5917a2a0-c14d-44ce-a27c-9fd15d6d7519]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c4c0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163'): ({'sdf'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Removing single pathed devices sdf {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a59ed5-e514-401e-823b-7d97e1dec695]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e050b033-5d68-44a2-8b50-11c9e011e30a]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Flushing IO for device /dev/sdf {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[027ef660-957a-4288-9631-ef70592b0900]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 938475520 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd12d94-b32d-4616-b027-0b083efea98a]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[253ae4ff-3559-4939-8f95-64ec9872eba4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbab38f6-e723-4f90-bfac-35e474e335a5]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163, portal: 172.16.0.220,3260]
Nov 13 17:22:12 user nova-compute[75100]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163, portal: 172.16.0.220,3260] successful.
Nov 13 17:22:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b32f771b-b2ae-43cc-8578-753ba1081163 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafd0719-2af5-4699-b00f-8c200e8efc02]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] <== disconnect_volume: return (398ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:22:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Deleting instance files /opt/stack/data/nova/instances/f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e_del
Nov 13 17:22:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Deletion of /opt/stack/data/nova/instances/f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e_del complete
Nov 13 17:22:12 user nova-compute[75100]: INFO nova.compute.manager [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Took 4.44 seconds to destroy the instance on the hypervisor.
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-d39b0c3c-7441-4e45-90fc-358c26b3bf08 req-301d7fd4-a398-48fd-8080-772ffd1f50d3 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d39b0c3c-7441-4e45-90fc-358c26b3bf08 req-301d7fd4-a398-48fd-8080-772ffd1f50d3 service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d39b0c3c-7441-4e45-90fc-358c26b3bf08 req-301d7fd4-a398-48fd-8080-772ffd1f50d3 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d39b0c3c-7441-4e45-90fc-358c26b3bf08 req-301d7fd4-a398-48fd-8080-772ffd1f50d3 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-d39b0c3c-7441-4e45-90fc-358c26b3bf08 req-301d7fd4-a398-48fd-8080-772ffd1f50d3 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-unplugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-d39b0c3c-7441-4e45-90fc-358c26b3bf08 req-301d7fd4-a398-48fd-8080-772ffd1f50d3 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-unplugged-a020143e-a824-46fb-8988-9de41419b4cc for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-d39b0c3c-7441-4e45-90fc-358c26b3bf08 req-301d7fd4-a398-48fd-8080-772ffd1f50d3 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d39b0c3c-7441-4e45-90fc-358c26b3bf08 req-301d7fd4-a398-48fd-8080-772ffd1f50d3 service nova] Acquiring lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d39b0c3c-7441-4e45-90fc-358c26b3bf08 req-301d7fd4-a398-48fd-8080-772ffd1f50d3 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d39b0c3c-7441-4e45-90fc-358c26b3bf08 req-301d7fd4-a398-48fd-8080-772ffd1f50d3 service nova] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-d39b0c3c-7441-4e45-90fc-358c26b3bf08 req-301d7fd4-a398-48fd-8080-772ffd1f50d3 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] No waiting events found dispatching network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:12 user nova-compute[75100]: WARNING nova.compute.manager [req-d39b0c3c-7441-4e45-90fc-358c26b3bf08 req-301d7fd4-a398-48fd-8080-772ffd1f50d3 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received unexpected event network-vif-plugged-a020143e-a824-46fb-8988-9de41419b4cc for instance with vm_state active and task_state deleting.
Nov 13 17:22:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fDIUWMRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '0f619716-2911-4802-8f9c-424cc1aa71ab'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:12 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae519ce-5e07-4324-adb9-b8f5881c78b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:22:12 user nova-compute[75100]: No targets found.
Nov 13 17:22:12 user nova-compute[75100]: iSNS:
Nov 13 17:22:12 user nova-compute[75100]: No targets found.
Nov 13 17:22:12 user nova-compute[75100]: STATIC:
Nov 13 17:22:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:22:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2
Nov 13 17:22:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab
Nov 13 17:22:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584
Nov 13 17:22:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:12 user nova-compute[75100]: FIRMWARE:
Nov 13 17:22:12 user nova-compute[75100]: No targets found.
Nov 13 17:22:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:22:12 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:22:12 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[579c4265-e0e3-4dcf-a375-6d50c6ea4218]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[332977c1-ba99-401a-84db-c1d9c223b943]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda802eff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3d9f75-f0ce-4d37-a177-4e3f8d0e0eea]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd53b99-d946-4919-b31c-5b0ba57cbb43]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3564677f-1247-4907-a410-7987aeaf1ccc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:22:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab04d01-7663-4ded-934a-a4196c6ecc30]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a22fbb7-f444-428b-be8d-2d364ee3e104]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9428a6f-a75b-4ad7-b713-a06009993c4a]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab, portal: 172.16.0.220,3260]
Nov 13 17:22:13 user nova-compute[75100]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab, portal: 172.16.0.220,3260] successful.
Nov 13 17:22:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f619716-2911-4802-8f9c-424cc1aa71ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[83febf9b-dbbe-44e8-92cc-bae1da7c0f8b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] <== disconnect_volume: return (326ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoixMywS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd88fd6b4-8e19-4b0a-a6d4-761187cd3c0f', 'attached_at': '', 'detached_at': '', 'volume_id': '601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'serial'} {{(pid=75100) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] swap_volume: removing Cinder connection for volume 0f619716-2911-4802-8f9c-424cc1aa71ab {{(pid=75100) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 13 17:22:13 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 7b8c5beb-5551-48b0-8331-bfcba175cc0e is timed out.
Nov 13 17:22:13 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Successfully detached device sdc from instance 7b8c5beb-5551-48b0-8331-bfcba175cc0e from the live domain config.
Nov 13 17:22:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVmsKqyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:13 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00e911e-a9e8-43b4-9864-1fff27409f81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:22:13 user nova-compute[75100]: No targets found.
Nov 13 17:22:13 user nova-compute[75100]: iSNS:
Nov 13 17:22:13 user nova-compute[75100]: No targets found.
Nov 13 17:22:13 user nova-compute[75100]: STATIC:
Nov 13 17:22:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:22:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2
Nov 13 17:22:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584
Nov 13 17:22:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:13 user nova-compute[75100]: FIRMWARE:
Nov 13 17:22:13 user nova-compute[75100]: No targets found.
Nov 13 17:22:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:22:13 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:22:13 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87de1fe-d19c-497e-9455-cc25eac2f287]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[639f0d4c-13a8-4ebc-b492-fd9e98925583]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:13 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:13 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:13 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:13 user nova-compute[75100]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 (non-flash)
Nov 13 17:22:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38f5d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2'): ({'sdh'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Removing single pathed devices sdh {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] swap_volume: Updating volume 0f619716-2911-4802-8f9c-424cc1aa71ab BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "BoixMywS", "auth_password": "2i63VQ8zJ0LarD", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "601d32c1-ae7b-4e54-9a54-eeadfecf6d62"}, "status": "reserved", "instance": "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f", "attached_at": "", "detached_at": "", "volume_id": "601d32c1-ae7b-4e54-9a54-eeadfecf6d62", "serial": "601d32c1-ae7b-4e54-9a54-eeadfecf6d62"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'no_device': None, 'attachment_id': '3a6ead8e-0b6f-43eb-842e-22d274f2e12e'} {{(pid=75100) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5151bb79-1b38-4962-ab91-c8fe94f12ddc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ac2a4e-615c-47ba-b06d-519f770ff336]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Flushing IO for device /dev/sdh {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-02650475-156c-4d20-99b2-11b670aecc54 tempest-TestVolumeSwap-281368418 tempest-TestVolumeSwap-281368418-project-admin] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.659s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b7974a-78ec-4b7f-9d0c-61e1bb28ab45]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:22:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.129s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c333a0-4287-4fb4-8010-cb8642ee8076]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] SCSI volumes sdh have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b49dc31-4d99-4c3e-a6c2-5f3d40f4041e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[922de591-76b3-49f4-9389-669484d5dc26]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2, portal: 172.16.0.220,3260]
Nov 13 17:22:14 user nova-compute[75100]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2, portal: 172.16.0.220,3260] successful.
Nov 13 17:22:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd454579-75ce-40cb-9a2c-407948da4ca2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[81884638-16ec-444c-8eb3-e44287d17199]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] <== disconnect_volume: return (406ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:22:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Creating image(s)
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Ensure instance console log exists: /opt/stack/data/nova/instances/5ead8372-787b-41f8-95cc-11dd49093606/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Start _get_guest_xml network_info=[{"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'b4db64c4-f5f2-4892-ba06-ef2f047d7300', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHOtjDqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5ead8372-787b-41f8-95cc-11dd49093606', 'attached_at': '', 'detached_at': '', 'volume_id': 'c111e555-d452-4770-b8c7-853575a07b0b', 'serial': 'c111e555-d452-4770-b8c7-853575a07b0b'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:22:14 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 17:22:14 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.objects.instance [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5ead8372-787b-41f8-95cc-11dd49093606 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHOtjDqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:14 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:14 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:14 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd964615-35ab-4449-8b80-dba5ff114624]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:22:14 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce514d9-4f4c-4dec-8e5c-a8eb825f26af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b] added
Nov 13 17:22:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4b48aa-56b7-49c1-bad7-579dba0e63bb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a48ecac-4389-48cc-9221-5824ff243dea]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHOtjDqT {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XHOtjDqT" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8634fad5-9b4a-464b-868d-de0180389bd2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XHOtjDqT'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-e1929ac4-a3be-40b4-a905-38dd48afb201 req-dec56125-7442-4b1f-859b-ba3698f119e5 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-deleted-e8660440-37a5-4e0e-a0cd-99ab02aaa577 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:14 user nova-compute[75100]: INFO nova.compute.manager [req-e1929ac4-a3be-40b4-a905-38dd48afb201 req-dec56125-7442-4b1f-859b-ba3698f119e5 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Neutron deleted interface e8660440-37a5-4e0e-a0cd-99ab02aaa577; detaching it from the instance and deleting it from the info cache
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-e1929ac4-a3be-40b4-a905-38dd48afb201 req-dec56125-7442-4b1f-859b-ba3698f119e5 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [{"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "address": "fa:16:3e:b5:6b:dc", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb401007f-7e", "ovs_interfaceid": "b401007f-7e49-4a6e-9ac9-1da782cfea31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8386f2d2-3581-4437-a68e-b711b4d0a3e2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-e1929ac4-a3be-40b4-a905-38dd48afb201 req-dec56125-7442-4b1f-859b-ba3698f119e5 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Detach interface failed, port_id=e8660440-37a5-4e0e-a0cd-99ab02aaa577, reason: Instance f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c63872-1e95-409a-9792-74dfd2036e0d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:14 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:14 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --login" returned: 0 in 0.150s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e996cae-6793-4302-9f56-fa13841db9b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260]
Nov 13 17:22:14 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260] successful.
Nov 13 17:22:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:14 user nova-compute[75100]: INFO nova.compute.manager [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Detaching volume 601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9fa059-796f-4a3c-a2ef-f906eff3cdd8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[125e7338-f4d0-409b-b6a7-d02f957396d6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:14 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:14 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:22:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:14 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:14 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:22:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e80675b-e6ce-45a9-b707-fcd7cb52b0df]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHOtjDqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:22:14 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lazy-loading 'flavor' on Instance uuid 7b8c5beb-5551-48b0-8331-bfcba175cc0e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:22:15 user nova-compute[75100]: INFO nova.virt.block_device [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Attempting to driver detach volume 601d32c1-ae7b-4e54-9a54-eeadfecf6d62 from mountpoint /dev/vdb
Nov 13 17:22:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Attempting to detach device vdb from instance d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:22:15 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:22:15 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 13 17:22:15 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:22:15 user nova-compute[75100]:   <serial>601d32c1-ae7b-4e54-9a54-eeadfecf6d62</serial>
Nov 13 17:22:15 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:22:15 user nova-compute[75100]: </disk>
Nov 13 17:22:15 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:22:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Successfully detached device vdb from instance d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f from the persistent domain config.
Nov 13 17:22:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:22:15 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:22:15 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 13 17:22:15 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:22:15 user nova-compute[75100]:   <serial>601d32c1-ae7b-4e54-9a54-eeadfecf6d62</serial>
Nov 13 17:22:15 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:22:15 user nova-compute[75100]: </disk>
Nov 13 17:22:15 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0c352a90-4b39-4430-983c-3ac03e8b04a0 tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.920s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 55c68a33-6003-4b98-a248-f5d3dafe77f1 is timed out.
Nov 13 17:22:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Successfully detached device vdb from instance 55c68a33-6003-4b98-a248-f5d3dafe77f1 from the live domain config.
Nov 13 17:22:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZDibPuaA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:15 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '26433626161323535', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433626161323535', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.584s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec48d7a-16e6-4508-9542-24561ddac64f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:22:15 user nova-compute[75100]: No targets found.
Nov 13 17:22:15 user nova-compute[75100]: iSNS:
Nov 13 17:22:15 user nova-compute[75100]: No targets found.
Nov 13 17:22:15 user nova-compute[75100]: STATIC:
Nov 13 17:22:15 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:22:15 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:15 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:15 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b
Nov 13 17:22:15 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:15 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:15 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584
Nov 13 17:22:15 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:15 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:15 user nova-compute[75100]: FIRMWARE:
Nov 13 17:22:15 user nova-compute[75100]: No targets found.
Nov 13 17:22:15 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:22:16 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:22:16 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-434015320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-716596890',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMHrvy6dRXfrXCI4JiaUSDCttbmdw96JfvW+n8ZiGKpKZMjmLzpK9h3eR71xlPMzcT2ZyjL7UJxtt2DhdOyrObd8ECbbaG5NFmjMFIEU9X7Qc7cQ7GuxVyy0CTzRSvdWw==',key_name='tempest-keypair-203724816',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec5af88d50944bbd9e6ec2ae84f194d2',ramdisk_id='',reservation_id='r-yqh7vk1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1979706355',owner_user_name='tempest-ServerActionsV293TestJSON-1979706355-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:22:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f56979d0e374f6ea4be1920f5f62fd9',uuid=5ead8372-787b-41f8-95cc-11dd49093606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Converting VIF {"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:22:16 user nova-compute[75100]:   <uuid>5ead8372-787b-41f8-95cc-11dd49093606</uuid>
Nov 13 17:22:16 user nova-compute[75100]:   <name>instance-0000000a</name>
Nov 13 17:22:16 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:22:16 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:22:16 user nova-compute[75100]:   <metadata>
Nov 13 17:22:16 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:22:16 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:22:16 user nova-compute[75100]:       <nova:name>tempest-ServerActionsV293TestJSON-server-434015320</nova:name>
Nov 13 17:22:16 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:22:14</nova:creationTime>
Nov 13 17:22:16 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:22:16 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:22:16 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:22:16 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:22:16 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:22:16 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:22:16 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:22:16 user nova-compute[75100]:       <nova:owner>
Nov 13 17:22:16 user nova-compute[75100]:         <nova:user uuid="4f56979d0e374f6ea4be1920f5f62fd9">tempest-ServerActionsV293TestJSON-1979706355-project-member</nova:user>
Nov 13 17:22:16 user nova-compute[75100]:         <nova:project uuid="ec5af88d50944bbd9e6ec2ae84f194d2">tempest-ServerActionsV293TestJSON-1979706355</nova:project>
Nov 13 17:22:16 user nova-compute[75100]:       </nova:owner>
Nov 13 17:22:16 user nova-compute[75100]:       <nova:ports>
Nov 13 17:22:16 user nova-compute[75100]:         <nova:port uuid="c364a290-68a0-4e5c-9865-a9b19620f0d1">
Nov 13 17:22:16 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 17:22:16 user nova-compute[75100]:         </nova:port>
Nov 13 17:22:16 user nova-compute[75100]:       </nova:ports>
Nov 13 17:22:16 user nova-compute[75100]:     </nova:instance>
Nov 13 17:22:16 user nova-compute[75100]:   </metadata>
Nov 13 17:22:16 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:22:16 user nova-compute[75100]:     <system>
Nov 13 17:22:16 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:22:16 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:22:16 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:22:16 user nova-compute[75100]:       <entry name="serial">5ead8372-787b-41f8-95cc-11dd49093606</entry>
Nov 13 17:22:16 user nova-compute[75100]:       <entry name="uuid">5ead8372-787b-41f8-95cc-11dd49093606</entry>
Nov 13 17:22:16 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:22:16 user nova-compute[75100]:     </system>
Nov 13 17:22:16 user nova-compute[75100]:   </sysinfo>
Nov 13 17:22:16 user nova-compute[75100]:   <os>
Nov 13 17:22:16 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:22:16 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:22:16 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:22:16 user nova-compute[75100]:   </os>
Nov 13 17:22:16 user nova-compute[75100]:   <features>
Nov 13 17:22:16 user nova-compute[75100]:     <acpi/>
Nov 13 17:22:16 user nova-compute[75100]:     <apic/>
Nov 13 17:22:16 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:22:16 user nova-compute[75100]:   </features>
Nov 13 17:22:16 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:22:16 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:22:16 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:22:16 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:22:16 user nova-compute[75100]:   </clock>
Nov 13 17:22:16 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:22:16 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:22:16 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:22:16 user nova-compute[75100]:   </cpu>
Nov 13 17:22:16 user nova-compute[75100]:   <devices>
Nov 13 17:22:16 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:22:16 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:22:16 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 13 17:22:16 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:22:16 user nova-compute[75100]:       <serial>c111e555-d452-4770-b8c7-853575a07b0b</serial>
Nov 13 17:22:16 user nova-compute[75100]:     </disk>
Nov 13 17:22:16 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:22:16 user nova-compute[75100]:       <mac address="fa:16:3e:dd:2b:2b"/>
Nov 13 17:22:16 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:22:16 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:22:16 user nova-compute[75100]:       <target dev="tapc364a290-68"/>
Nov 13 17:22:16 user nova-compute[75100]:     </interface>
Nov 13 17:22:16 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:22:16 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/5ead8372-787b-41f8-95cc-11dd49093606/console.log" append="off"/>
Nov 13 17:22:16 user nova-compute[75100]:     </serial>
Nov 13 17:22:16 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:22:16 user nova-compute[75100]:     <video>
Nov 13 17:22:16 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:22:16 user nova-compute[75100]:     </video>
Nov 13 17:22:16 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:22:16 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:22:16 user nova-compute[75100]:     </rng>
Nov 13 17:22:16 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:22:16 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:22:16 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:22:16 user nova-compute[75100]:     </memballoon>
Nov 13 17:22:16 user nova-compute[75100]:   </devices>
Nov 13 17:22:16 user nova-compute[75100]: </domain>
Nov 13 17:22:16 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-434015320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-716596890',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMHrvy6dRXfrXCI4JiaUSDCttbmdw96JfvW+n8ZiGKpKZMjmLzpK9h3eR71xlPMzcT2ZyjL7UJxtt2DhdOyrObd8ECbbaG5NFmjMFIEU9X7Qc7cQ7GuxVyy0CTzRSvdWw==',key_name='tempest-keypair-203724816',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ec5af88d50944bbd9e6ec2ae84f194d2',ramdisk_id='',reservation_id='r-yqh7vk1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1979706355',owner_user_name='tempest-ServerActionsV293TestJSON-1979706355-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:22:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f56979d0e374f6ea4be1920f5f62fd9',uuid=5ead8372-787b-41f8-95cc-11dd49093606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Converting VIF {"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_vif [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caf08ca-7dd7-4fda-8243-e64b3342e528]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df67ad35-2932-535e-b98b-cec490f0d2e0', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc364a290-68, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc364a290-68, col_values=(('qos', UUID('6f72004c-db06-43e4-8afc-a905608e13e0')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc364a290-68, col_values=(('external_ids', {'iface-id': 'c364a290-68a0-4e5c-9865-a9b19620f0d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:2b:2b', 'vm-uuid': '5ead8372-787b-41f8-95cc-11dd49093606'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:16 user nova-compute[75100]: INFO os_vif [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68')
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a723e093-aa1c-460a-aeab-ef1cc51b198b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:16 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:16 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:22:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 (non-flash)
Nov 13 17:22:16 user nova-compute[75100]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:16 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:22:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38d03010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584'): ({'sdi'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Removing single pathed devices sdi {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e1cad6-b512-45c4-90b5-dc59b819203d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] No VIF found with MAC fa:16:3e:dd:2b:2b, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[74095237-0d44-4a51-b61a-ebfc31c2feba]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Flushing IO for device /dev/sdi {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[595227c1-f2b1-4ca7-92b0-1bf97ec61e83]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.037s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[964d85a1-3e24-47b4-ac83-b1054e8cf3cc]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] SCSI volumes sdi have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bff013-4e91-4a6a-b18f-9a5f0a6faa79]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[27da681e-9cc3-4111-88da-b3fddd8c738d]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584, portal: 172.16.0.220,3260]
Nov 13 17:22:16 user nova-compute[75100]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584, portal: 172.16.0.220,3260] successful.
Nov 13 17:22:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:16 user nova-compute[75100]: INFO nova.compute.manager [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Terminating instance
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce74a1b-16d6-4337-b3e9-7065fc5a1584 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd2cbf-f495-41c3-9d7a-d466f3d4ab8f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] <== disconnect_volume: return (916ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-deleted-b401007f-7e49-4a6e-9ac9-1da782cfea31 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:16 user nova-compute[75100]: INFO nova.compute.manager [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Neutron deleted interface b401007f-7e49-4a6e-9ac9-1da782cfea31; detaching it from the instance and deleting it from the info cache
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [{"id": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "address": "fa:16:3e:ef:bc:c8", "network": {"id": "5bf875da-58d1-4ba4-8e2a-6cca9e5199ea", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-388259387-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9c51ce-9d", "ovs_interfaceid": "8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Detach interface failed, port_id=b401007f-7e49-4a6e-9ac9-1da782cfea31, reason: Instance f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-deleted-8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:16 user nova-compute[75100]: INFO nova.compute.manager [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Neutron deleted interface 8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340; detaching it from the instance and deleting it from the info cache
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [{"id": "a020143e-a824-46fb-8988-9de41419b4cc", "address": "fa:16:3e:1e:aa:32", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa020143e-a8", "ovs_interfaceid": "a020143e-a824-46fb-8988-9de41419b4cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "address": "fa:16:3e:ec:f2:c7", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.248", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c1300f5-b3", "ovs_interfaceid": "6c1300f5-b3ad-4524-8d4b-dd0d93fbf60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c69ece98-a175-4524-b5b6-acf4d6804db7", "address": "fa:16:3e:6b:dd:6b", "network": {"id": "3f7ab502-887f-411a-96dd-744f5f3af3b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1379374500", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc69ece98-a1", "ovs_interfaceid": "c69ece98-a175-4524-b5b6-acf4d6804db7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "address": "fa:16:3e:17:65:3b", "network": {"id": "d6c43b9a-3d3a-4f3e-9344-f00d65844989", "bridge": "br-int", "label": "tempest-device-tagging-net2-2064566118", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "04e7fe01efa34fc489341a2429a5c754", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf74a46ed-40", "ovs_interfaceid": "f74a46ed-40fb-40ab-ad63-74b69ab3a6ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Detach interface failed, port_id=8d9c51ce-9dc8-4f9f-b89a-fac95a5f3340, reason: Instance f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Received event network-vif-unplugged-bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] Acquiring lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] No waiting events found dispatching network-vif-unplugged-bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-19d3c026-1a45-464c-bcad-f1f2e8589434 req-20b5583e-61b7-470a-82c2-51cdd91e86d8 service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Received event network-vif-unplugged-bd9178d4-3984-4df2-8531-8dd8f4da4510 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:22:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lazy-loading 'flavor' on Instance uuid 55c68a33-6003-4b98-a248-f5d3dafe77f1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba74076a-d1f4-47dc-9baa-6623c0a23112 tempest-VolumesAssistedSnapshotsTest-1638585807 tempest-VolumesAssistedSnapshotsTest-1638585807-project-admin] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.438s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Instance destroyed successfully.
Nov 13 17:22:17 user nova-compute[75100]: DEBUG nova.objects.instance [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lazy-loading 'resources' on Instance uuid 7b8c5beb-5551-48b0-8331-bfcba175cc0e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1625328849',display_name='tempest-AttachSCSIVolumeTestJSON-server-1625328849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1625328849',id=8,image_ref='857f07b6-9fc2-45c9-bc43-cae739b24535',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM+VB5OPtx/uNJgmE3eyN6mqh8Awk15gHnlzzQmk6+WnP1lkiC1y6KRhXi55NU3UUwdE8fCBFyH5dEeqc49l84MOiQTn6iyW4ETWlD1XXyCTpOVayfITW5yBIrIouOL+/g==',key_name='tempest-keypair-860922806',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='078f6299ef104b968a06e3e9cd6dd5cb',ramdisk_id='',reservation_id='r-u8wxsl2v',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='857f07b6-9fc2-45c9-bc43-cae739b24535',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-145313973',owner_user_name='tempest-AttachSCSIVolumeTestJSON-145313973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:20:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f346412051341acaad45c7e3ed974c3',uuid=7b8c5beb-5551-48b0-8331-bfcba175cc0e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "address": "fa:16:3e:4b:75:c5", "network": {"id": "17f39e27-bb24-456e-9bb4-6db6772309b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-944565688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078f6299ef104b968a06e3e9cd6dd5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9178d4-39", "ovs_interfaceid": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Converting VIF {"id": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "address": "fa:16:3e:4b:75:c5", "network": {"id": "17f39e27-bb24-456e-9bb4-6db6772309b7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-944565688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "078f6299ef104b968a06e3e9cd6dd5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd9178d4-39", "ovs_interfaceid": "bd9178d4-3984-4df2-8531-8dd8f4da4510", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:75:c5,bridge_name='br-int',has_traffic_filtering=True,id=bd9178d4-3984-4df2-8531-8dd8f4da4510,network=Network(17f39e27-bb24-456e-9bb4-6db6772309b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9178d4-39') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG os_vif [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:75:c5,bridge_name='br-int',has_traffic_filtering=True,id=bd9178d4-3984-4df2-8531-8dd8f4da4510,network=Network(17f39e27-bb24-456e-9bb4-6db6772309b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9178d4-39') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd9178d4-39, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e2904d7-8972-4ef4-a53e-b821e1e1fbfc) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:17 user nova-compute[75100]: INFO os_vif [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:75:c5,bridge_name='br-int',has_traffic_filtering=True,id=bd9178d4-3984-4df2-8531-8dd8f4da4510,network=Network(17f39e27-bb24-456e-9bb4-6db6772309b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd9178d4-39')
Nov 13 17:22:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Deleting instance files /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e_del
Nov 13 17:22:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Deletion of /opt/stack/data/nova/instances/7b8c5beb-5551-48b0-8331-bfcba175cc0e_del complete
Nov 13 17:22:17 user nova-compute[75100]: INFO nova.compute.manager [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 13 17:22:17 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:22:17 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Took 5.01 seconds to deallocate network for instance.
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:22:18 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Took 0.69 seconds to deallocate network for instance.
Nov 13 17:22:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-7f66ee1b-826c-433a-a2dc-f51227faf463 req-f4f10ce9-592f-41cd-824f-f203aebe1260 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7f66ee1b-826c-433a-a2dc-f51227faf463 req-f4f10ce9-592f-41cd-824f-f203aebe1260 service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7f66ee1b-826c-433a-a2dc-f51227faf463 req-f4f10ce9-592f-41cd-824f-f203aebe1260 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7f66ee1b-826c-433a-a2dc-f51227faf463 req-f4f10ce9-592f-41cd-824f-f203aebe1260 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-7f66ee1b-826c-433a-a2dc-f51227faf463 req-f4f10ce9-592f-41cd-824f-f203aebe1260 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] No waiting events found dispatching network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:18 user nova-compute[75100]: WARNING nova.compute.manager [req-7f66ee1b-826c-433a-a2dc-f51227faf463 req-f4f10ce9-592f-41cd-824f-f203aebe1260 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received unexpected event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:18 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Deleted allocations for instance 7b8c5beb-5551-48b0-8331-bfcba175cc0e
Nov 13 17:22:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-4527f617-c01e-489c-8894-faa67f9bd3f4 req-172b9092-d1a0-4dc9-988e-c7121ec7dcca service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Received event network-vif-plugged-bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4527f617-c01e-489c-8894-faa67f9bd3f4 req-172b9092-d1a0-4dc9-988e-c7121ec7dcca service nova] Acquiring lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4527f617-c01e-489c-8894-faa67f9bd3f4 req-172b9092-d1a0-4dc9-988e-c7121ec7dcca service nova] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4527f617-c01e-489c-8894-faa67f9bd3f4 req-172b9092-d1a0-4dc9-988e-c7121ec7dcca service nova] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-4527f617-c01e-489c-8894-faa67f9bd3f4 req-172b9092-d1a0-4dc9-988e-c7121ec7dcca service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] No waiting events found dispatching network-vif-plugged-bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:18 user nova-compute[75100]: WARNING nova.compute.manager [req-4527f617-c01e-489c-8894-faa67f9bd3f4 req-172b9092-d1a0-4dc9-988e-c7121ec7dcca service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Received unexpected event network-vif-plugged-bd9178d4-3984-4df2-8531-8dd8f4da4510 for instance with vm_state deleted and task_state None.
Nov 13 17:22:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-4527f617-c01e-489c-8894-faa67f9bd3f4 req-172b9092-d1a0-4dc9-988e-c7121ec7dcca service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-deleted-c69ece98-a175-4524-b5b6-acf4d6804db7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-4527f617-c01e-489c-8894-faa67f9bd3f4 req-172b9092-d1a0-4dc9-988e-c7121ec7dcca service nova] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Received event network-vif-deleted-f74a46ed-40fb-40ab-ad63-74b69ab3a6ef {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-4527f617-c01e-489c-8894-faa67f9bd3f4 req-172b9092-d1a0-4dc9-988e-c7121ec7dcca service nova] [instance: 7b8c5beb-5551-48b0-8331-bfcba175cc0e] Received event network-vif-deleted-bd9178d4-3984-4df2-8531-8dd8f4da4510 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-41c14e6d-9daa-415d-8199-6d4ebfbb548f tempest-AttachSCSIVolumeTestJSON-145313973 tempest-AttachSCSIVolumeTestJSON-145313973-project-member] Lock "7b8c5beb-5551-48b0-8331-bfcba175cc0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.684s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Updating instance_info_cache with network_info: [{"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:22:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:22:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:22:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:22:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-eaf71ced-24ac-47be-bbe0-5d7ea2af5b44 req-5c03171d-666a-473c-a2d8-11fc3136d361 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eaf71ced-24ac-47be-bbe0-5d7ea2af5b44 req-5c03171d-666a-473c-a2d8-11fc3136d361 service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eaf71ced-24ac-47be-bbe0-5d7ea2af5b44 req-5c03171d-666a-473c-a2d8-11fc3136d361 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-eaf71ced-24ac-47be-bbe0-5d7ea2af5b44 req-5c03171d-666a-473c-a2d8-11fc3136d361 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-eaf71ced-24ac-47be-bbe0-5d7ea2af5b44 req-5c03171d-666a-473c-a2d8-11fc3136d361 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] No waiting events found dispatching network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:20 user nova-compute[75100]: WARNING nova.compute.manager [req-eaf71ced-24ac-47be-bbe0-5d7ea2af5b44 req-5c03171d-666a-473c-a2d8-11fc3136d361 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received unexpected event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:22:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Instance spawned successfully.
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:22:20 user nova-compute[75100]: INFO nova.compute.manager [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] [instance: f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e] Took 2.89 seconds to detach 3 volumes for instance.
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.313s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:20 user nova-compute[75100]: DEBUG nova.objects.instance [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75100) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 13 17:22:20 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Deleted allocations for instance f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e
Nov 13 17:22:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8794e85c-2bae-461b-b960-ce717745b4bd tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.216s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48018f8c-7605-4bf8-81a1-9ec0b3ce919b tempest-TaggedBootDevicesTest-921800196 tempest-TaggedBootDevicesTest-921800196-project-member] Lock "f17cdb1f-e4c0-4c2e-97dc-786a8b7e2d0e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.041s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:22:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7722MB free_disk=25.451801300048828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 64c9f78b-8ce5-4328-9fb0-93715df6135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 55c68a33-6003-4b98-a248-f5d3dafe77f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 5ead8372-787b-41f8-95cc-11dd49093606 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:22:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:22:26 user nova-compute[75100]: INFO nova.compute.claims [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Claim successful on node user
Nov 13 17:22:26 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:22:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:22:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:22:26 user nova-compute[75100]: DEBUG nova.policy [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77f5fd132c0e46438884eaffae0beab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf7bde4b774e3dac46d41d32496efa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:22:26 user nova-compute[75100]: INFO nova.virt.block_device [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Booting with blank volume at /dev/vda
Nov 13 17:22:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Successfully created port: d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Successfully updated port: d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquired lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-7ec0313b-bb6b-48c7-a2da-263e4e55fa95 req-7ed089cc-c83d-4089-9e04-91bc4a4a1043 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-changed-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-7ec0313b-bb6b-48c7-a2da-263e4e55fa95 req-7ed089cc-c83d-4089-9e04-91bc4a4a1043 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Refreshing instance network info cache due to event network-changed-d15270b0-a020-4fc1-bac3-3ea3da038478. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:22:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7ec0313b-bb6b-48c7-a2da-263e4e55fa95 req-7ed089cc-c83d-4089-9e04-91bc4a4a1043 service nova] Acquiring lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:22:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:22:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Updating instance_info_cache with network_info: [{"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:22:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Releasing lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:22:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Instance network_info: |[{"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:22:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7ec0313b-bb6b-48c7-a2da-263e4e55fa95 req-7ed089cc-c83d-4089-9e04-91bc4a4a1043 service nova] Acquired lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:22:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-7ec0313b-bb6b-48c7-a2da-263e4e55fa95 req-7ed089cc-c83d-4089-9e04-91bc4a4a1043 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Refreshing network info cache for port d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:22:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-7ec0313b-bb6b-48c7-a2da-263e4e55fa95 req-7ed089cc-c83d-4089-9e04-91bc4a4a1043 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Updated VIF entry in instance network info cache for port d15270b0-a020-4fc1-bac3-3ea3da038478. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:22:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-7ec0313b-bb6b-48c7-a2da-263e4e55fa95 req-7ed089cc-c83d-4089-9e04-91bc4a4a1043 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Updating instance_info_cache with network_info: [{"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:22:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7ec0313b-bb6b-48c7-a2da-263e4e55fa95 req-7ed089cc-c83d-4089-9e04-91bc4a4a1043 service nova] Releasing lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:22:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:22:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:22:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:22:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:32 user nova-compute[75100]: DEBUG os_brick.utils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[859b12ac-8d89-4cf6-b2f7-1bfb900a897b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed5b5aa-63ab-4267-91de-8787357b04f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b1b05e-c216-4a17-b1be-a43938328865]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d57d44-a670-462d-ac1d-3e57f3db94ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:22:33 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:22:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3c2458-d3c5-422b-ab3f-8689cb910cdb]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG os_brick.utils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:33 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Updating existing volume attachment record: 5df1ce95-5084-4e7f-93d6-f07c0b9959a3 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:22:35 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f is timed out.
Nov 13 17:22:35 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Successfully detached device vdb from instance d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f from the live domain config.
Nov 13 17:22:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BoixMywS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '601d32c1-ae7b-4e54-9a54-eeadfecf6d62'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:35 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e36aaa-fe45-4a9f-8fc5-63b64a193550]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:22:35 user nova-compute[75100]: No targets found.
Nov 13 17:22:35 user nova-compute[75100]: iSNS:
Nov 13 17:22:35 user nova-compute[75100]: No targets found.
Nov 13 17:22:35 user nova-compute[75100]: STATIC:
Nov 13 17:22:35 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62
Nov 13 17:22:35 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:35 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:35 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b
Nov 13 17:22:35 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:22:35 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:22:35 user nova-compute[75100]: FIRMWARE:
Nov 13 17:22:35 user nova-compute[75100]: No targets found.
Nov 13 17:22:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:22:35 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:22:35 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec9803b-71c7-4e14-a913-0adee9c49f42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bcf497-a7d6-4f40-a238-bd295c98f8f8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:35 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:22:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 (non-flash)
Nov 13 17:22:35 user nova-compute[75100]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:22:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c4c09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05215c6-ef7a-4bdb-bbd2-13209be82064]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6111188-2c57-4997-8da5-bc320b9e0333]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cb39da-9351-4762-946a-05a962a914ab]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ecdf39-6f52-4331-9558-cf8eddb8ae0a]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[52169450-dbc8-49d5-9cd2-bd18668d7e57]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c743b3b-94d0-479b-84e8-6860b2cde018]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260]
Nov 13 17:22:35 user nova-compute[75100]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62, portal: 172.16.0.220,3260] successful.
Nov 13 17:22:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:601d32c1-ae7b-4e54-9a54-eeadfecf6d62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0681b53-e416-473f-8816-7da0658fea67]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] <== disconnect_volume: return (287ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:22:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:36 user nova-compute[75100]: DEBUG nova.objects.instance [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lazy-loading 'flavor' on Instance uuid d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:22:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-10f81697-938d-43fb-a913-90802b15a86e tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.102s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:22:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Creating image(s)
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Ensure instance console log exists: /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Start _get_guest_xml network_info=[{"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '5df1ce95-5084-4e7f-93d6-f07c0b9959a3', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxgqfret', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83d28254-9d5f-4190-85de-76f5a2b69dac', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4b547be-9d01-4fe4-86fc-b62242a82ab9', 'serial': 'a4b547be-9d01-4fe4-86fc-b62242a82ab9'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:22:37 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:22:37 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxgqfret', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:37 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:37 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:37 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a207540-440b-4788-a940-49447b1d8d74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:22:37 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[220f6299-905c-44fe-b21d-2031ce75d128]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9] added
Nov 13 17:22:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[037dbb08-c12a-48ae-8873-2e48bd864823]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7621fea-c859-4ffe-8af5-6fc1a085d6cb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxgqfret {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxgqfret" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bd1bd2-c434-4f0d-b9d2-3350eaf55a7b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jxgqfret'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58a8639-5206-467f-8a25-a6630c1ceb91]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c233b6e4-fbe5-424c-982d-878d498543e9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:22:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:22:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85cf220-3107-451b-b778-b7388e7f669c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9, portal: 172.16.0.220,3260]
Nov 13 17:22:37 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9, portal: 172.16.0.220,3260] successful.
Nov 13 17:22:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd5c91b-7635-4472-bb1f-783f81fa476d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e5f00d-0e8c-4f3b-9311-556536890034]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:22:37 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:22:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:22:37 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:22:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[46efb989-98f1-4b47-b08d-8617cd7cedf8]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:22:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxgqfret', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26465366534376235', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465366534376235', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:22:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2044782487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2044782487',id=13,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-pohevv18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:22:27Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=83d28254-9d5f-4190-85de-76f5a2b69dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=d15270b0-a020-4fc1-bac3-3ea3da038478,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15270b0-a0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'pci_devices' on Instance uuid 83d28254-9d5f-4190-85de-76f5a2b69dac {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:22:38 user nova-compute[75100]:   <uuid>83d28254-9d5f-4190-85de-76f5a2b69dac</uuid>
Nov 13 17:22:38 user nova-compute[75100]:   <name>instance-0000000d</name>
Nov 13 17:22:38 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:22:38 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:22:38 user nova-compute[75100]:   <metadata>
Nov 13 17:22:38 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:22:38 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:22:38 user nova-compute[75100]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2044782487</nova:name>
Nov 13 17:22:38 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:22:37</nova:creationTime>
Nov 13 17:22:38 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:22:38 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:22:38 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:22:38 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:22:38 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:22:38 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:22:38 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:22:38 user nova-compute[75100]:       <nova:owner>
Nov 13 17:22:38 user nova-compute[75100]:         <nova:user uuid="77f5fd132c0e46438884eaffae0beab9">tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member</nova:user>
Nov 13 17:22:38 user nova-compute[75100]:         <nova:project uuid="f1bf7bde4b774e3dac46d41d32496efa">tempest-ServerBootFromVolumeStableRescueTest-1217233624</nova:project>
Nov 13 17:22:38 user nova-compute[75100]:       </nova:owner>
Nov 13 17:22:38 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:22:38 user nova-compute[75100]:       <nova:ports>
Nov 13 17:22:38 user nova-compute[75100]:         <nova:port uuid="d15270b0-a020-4fc1-bac3-3ea3da038478">
Nov 13 17:22:38 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 17:22:38 user nova-compute[75100]:         </nova:port>
Nov 13 17:22:38 user nova-compute[75100]:       </nova:ports>
Nov 13 17:22:38 user nova-compute[75100]:     </nova:instance>
Nov 13 17:22:38 user nova-compute[75100]:   </metadata>
Nov 13 17:22:38 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:22:38 user nova-compute[75100]:     <system>
Nov 13 17:22:38 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:22:38 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:22:38 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:22:38 user nova-compute[75100]:       <entry name="serial">83d28254-9d5f-4190-85de-76f5a2b69dac</entry>
Nov 13 17:22:38 user nova-compute[75100]:       <entry name="uuid">83d28254-9d5f-4190-85de-76f5a2b69dac</entry>
Nov 13 17:22:38 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:22:38 user nova-compute[75100]:     </system>
Nov 13 17:22:38 user nova-compute[75100]:   </sysinfo>
Nov 13 17:22:38 user nova-compute[75100]:   <os>
Nov 13 17:22:38 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:22:38 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:22:38 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:22:38 user nova-compute[75100]:   </os>
Nov 13 17:22:38 user nova-compute[75100]:   <features>
Nov 13 17:22:38 user nova-compute[75100]:     <acpi/>
Nov 13 17:22:38 user nova-compute[75100]:     <apic/>
Nov 13 17:22:38 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:22:38 user nova-compute[75100]:   </features>
Nov 13 17:22:38 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:22:38 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:22:38 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:22:38 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:22:38 user nova-compute[75100]:   </clock>
Nov 13 17:22:38 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:22:38 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:22:38 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:22:38 user nova-compute[75100]:   </cpu>
Nov 13 17:22:38 user nova-compute[75100]:   <devices>
Nov 13 17:22:38 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:22:38 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:22:38 user nova-compute[75100]:       <source dev="/dev/sdc"/>
Nov 13 17:22:38 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:22:38 user nova-compute[75100]:       <serial>a4b547be-9d01-4fe4-86fc-b62242a82ab9</serial>
Nov 13 17:22:38 user nova-compute[75100]:     </disk>
Nov 13 17:22:38 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:22:38 user nova-compute[75100]:       <mac address="fa:16:3e:d0:d9:37"/>
Nov 13 17:22:38 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:22:38 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:22:38 user nova-compute[75100]:       <target dev="tapd15270b0-a0"/>
Nov 13 17:22:38 user nova-compute[75100]:     </interface>
Nov 13 17:22:38 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:22:38 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/console.log" append="off"/>
Nov 13 17:22:38 user nova-compute[75100]:     </serial>
Nov 13 17:22:38 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:22:38 user nova-compute[75100]:     <video>
Nov 13 17:22:38 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:22:38 user nova-compute[75100]:     </video>
Nov 13 17:22:38 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:22:38 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:22:38 user nova-compute[75100]:     </rng>
Nov 13 17:22:38 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:22:38 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:22:38 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:22:38 user nova-compute[75100]:     </memballoon>
Nov 13 17:22:38 user nova-compute[75100]:   </devices>
Nov 13 17:22:38 user nova-compute[75100]: </domain>
Nov 13 17:22:38 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:22:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2044782487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2044782487',id=13,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-pohevv18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:22:27Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=83d28254-9d5f-4190-85de-76f5a2b69dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=d15270b0-a020-4fc1-bac3-3ea3da038478,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15270b0-a0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG os_vif [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=d15270b0-a020-4fc1-bac3-3ea3da038478,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15270b0-a0') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0119e4a-fec4-5b85-8619-d13c80377983', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd15270b0-a0, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd15270b0-a0, col_values=(('qos', UUID('ae57f27a-b7d5-4d17-b5a4-41be8c4bf7b8')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd15270b0-a0, col_values=(('external_ids', {'iface-id': 'd15270b0-a020-4fc1-bac3-3ea3da038478', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:d9:37', 'vm-uuid': '83d28254-9d5f-4190-85de-76f5a2b69dac'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:38 user nova-compute[75100]: INFO os_vif [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=d15270b0-a020-4fc1-bac3-3ea3da038478,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15270b0-a0')
Nov 13 17:22:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:22:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No VIF found with MAC fa:16:3e:d0:d9:37, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:22:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-aa632e3f-54ab-4d0a-bce5-7fe3648b6255 req-a2d28505-a65f-48fe-8cc4-511e3a8ca92b service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-aa632e3f-54ab-4d0a-bce5-7fe3648b6255 req-a2d28505-a65f-48fe-8cc4-511e3a8ca92b service nova] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-aa632e3f-54ab-4d0a-bce5-7fe3648b6255 req-a2d28505-a65f-48fe-8cc4-511e3a8ca92b service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-aa632e3f-54ab-4d0a-bce5-7fe3648b6255 req-a2d28505-a65f-48fe-8cc4-511e3a8ca92b service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-aa632e3f-54ab-4d0a-bce5-7fe3648b6255 req-a2d28505-a65f-48fe-8cc4-511e3a8ca92b service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] No waiting events found dispatching network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:40 user nova-compute[75100]: WARNING nova.compute.manager [req-aa632e3f-54ab-4d0a-bce5-7fe3648b6255 req-a2d28505-a65f-48fe-8cc4-511e3a8ca92b service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received unexpected event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 for instance with vm_state building and task_state spawning.
Nov 13 17:22:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-cc024478-1ce0-4a20-8b2c-035354d3d782 req-eb549c72-b1c3-4bf5-b075-d2bd1b800e73 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cc024478-1ce0-4a20-8b2c-035354d3d782 req-eb549c72-b1c3-4bf5-b075-d2bd1b800e73 service nova] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cc024478-1ce0-4a20-8b2c-035354d3d782 req-eb549c72-b1c3-4bf5-b075-d2bd1b800e73 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cc024478-1ce0-4a20-8b2c-035354d3d782 req-eb549c72-b1c3-4bf5-b075-d2bd1b800e73 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-cc024478-1ce0-4a20-8b2c-035354d3d782 req-eb549c72-b1c3-4bf5-b075-d2bd1b800e73 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] No waiting events found dispatching network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:42 user nova-compute[75100]: WARNING nova.compute.manager [req-cc024478-1ce0-4a20-8b2c-035354d3d782 req-eb549c72-b1c3-4bf5-b075-d2bd1b800e73 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received unexpected event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 for instance with vm_state building and task_state spawning.
Nov 13 17:22:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:22:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:22:43 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Instance spawned successfully.
Nov 13 17:22:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:22:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:22:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:22:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:22:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:22:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:22:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:22:43 user nova-compute[75100]: INFO nova.compute.manager [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 13 17:22:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:22:43 user nova-compute[75100]: INFO nova.compute.manager [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Took 17.10 seconds to build instance.
Nov 13 17:22:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-38a94d16-d93b-4f58-9758-0dd972bab67a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.227s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Acquiring lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Acquiring lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:46 user nova-compute[75100]: INFO nova.compute.manager [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Terminating instance
Nov 13 17:22:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-2e8e9773-d7a7-44e4-826d-4c5ec1051579 req-101fe72d-64b6-44b3-abf0-79cf13c4a398 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Received event network-vif-unplugged-a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2e8e9773-d7a7-44e4-826d-4c5ec1051579 req-101fe72d-64b6-44b3-abf0-79cf13c4a398 service nova] Acquiring lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2e8e9773-d7a7-44e4-826d-4c5ec1051579 req-101fe72d-64b6-44b3-abf0-79cf13c4a398 service nova] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2e8e9773-d7a7-44e4-826d-4c5ec1051579 req-101fe72d-64b6-44b3-abf0-79cf13c4a398 service nova] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-2e8e9773-d7a7-44e4-826d-4c5ec1051579 req-101fe72d-64b6-44b3-abf0-79cf13c4a398 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] No waiting events found dispatching network-vif-unplugged-a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-2e8e9773-d7a7-44e4-826d-4c5ec1051579 req-101fe72d-64b6-44b3-abf0-79cf13c4a398 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Received event network-vif-unplugged-a8348145-5a89-4365-ae02-deeb30863eae for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:22:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:47 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Instance destroyed successfully.
Nov 13 17:22:47 user nova-compute[75100]: DEBUG nova.objects.instance [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lazy-loading 'resources' on Instance uuid 55c68a33-6003-4b98-a248-f5d3dafe77f1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1785488374',display_name='tempest-VolumesAssistedSnapshotsTest-server-1785488374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1785488374',id=9,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAWZULFtHhZTSVb1x81RT8YxhCD8hcoaUpiNDt1TIf6X/s8dX/ZGEaiUmNzoJAdZxp8TKq4JB8+bB3geWNrJLIBqtkAOLDXgmuOwwXkHWoOxCx0AwmTMpN7Z2NwxZpciQ==',key_name='tempest-keypair-1814116729',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='633318b44b824f79a91e414700c3bc97',ramdisk_id='',reservation_id='r-a2y5010r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1084063573',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1084063573-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:20:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f5cc4868e77e468cae8b8fd0c29f2358',uuid=55c68a33-6003-4b98-a248-f5d3dafe77f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8348145-5a89-4365-ae02-deeb30863eae", "address": "fa:16:3e:ae:4f:f2", "network": {"id": "1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1383323174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633318b44b824f79a91e414700c3bc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8348145-5a", "ovs_interfaceid": "a8348145-5a89-4365-ae02-deeb30863eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Converting VIF {"id": "a8348145-5a89-4365-ae02-deeb30863eae", "address": "fa:16:3e:ae:4f:f2", "network": {"id": "1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1383323174-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "633318b44b824f79a91e414700c3bc97", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8348145-5a", "ovs_interfaceid": "a8348145-5a89-4365-ae02-deeb30863eae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:4f:f2,bridge_name='br-int',has_traffic_filtering=True,id=a8348145-5a89-4365-ae02-deeb30863eae,network=Network(1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8348145-5a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG os_vif [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:4f:f2,bridge_name='br-int',has_traffic_filtering=True,id=a8348145-5a89-4365-ae02-deeb30863eae,network=Network(1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8348145-5a') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8348145-5a, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00869ad8-137c-4bf3-8fb5-1199f1ebccea) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:47 user nova-compute[75100]: INFO os_vif [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:4f:f2,bridge_name='br-int',has_traffic_filtering=True,id=a8348145-5a89-4365-ae02-deeb30863eae,network=Network(1d9a3769-13ea-4fba-8cb4-ef5cbf5eb9ef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8348145-5a')
Nov 13 17:22:47 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Deleting instance files /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1_del
Nov 13 17:22:47 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Deletion of /opt/stack/data/nova/instances/55c68a33-6003-4b98-a248-f5d3dafe77f1_del complete
Nov 13 17:22:47 user nova-compute[75100]: INFO nova.compute.manager [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 17:22:47 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:22:47 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:22:48 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:22:48 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Took 0.94 seconds to deallocate network for instance.
Nov 13 17:22:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-36d2dc8f-398b-42ef-824f-8569d1dd5bc0 req-fb288b9e-9743-40f7-b713-8327caa20ab1 service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Received event network-vif-deleted-a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:48 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:22:48 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:22:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:48 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Deleted allocations for instance 55c68a33-6003-4b98-a248-f5d3dafe77f1
Nov 13 17:22:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-57eef5b1-6e94-4686-b94b-56251ae37895 req-0709e3c3-00c5-479f-a676-a854cab5cc3d service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Received event network-vif-plugged-a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57eef5b1-6e94-4686-b94b-56251ae37895 req-0709e3c3-00c5-479f-a676-a854cab5cc3d service nova] Acquiring lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57eef5b1-6e94-4686-b94b-56251ae37895 req-0709e3c3-00c5-479f-a676-a854cab5cc3d service nova] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57eef5b1-6e94-4686-b94b-56251ae37895 req-0709e3c3-00c5-479f-a676-a854cab5cc3d service nova] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-57eef5b1-6e94-4686-b94b-56251ae37895 req-0709e3c3-00c5-479f-a676-a854cab5cc3d service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] No waiting events found dispatching network-vif-plugged-a8348145-5a89-4365-ae02-deeb30863eae {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:22:48 user nova-compute[75100]: WARNING nova.compute.manager [req-57eef5b1-6e94-4686-b94b-56251ae37895 req-0709e3c3-00c5-479f-a676-a854cab5cc3d service nova] [instance: 55c68a33-6003-4b98-a248-f5d3dafe77f1] Received unexpected event network-vif-plugged-a8348145-5a89-4365-ae02-deeb30863eae for instance with vm_state deleted and task_state None.
Nov 13 17:22:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-16820548-f856-4c92-82bc-f1864b256746 tempest-VolumesAssistedSnapshotsTest-1084063573 tempest-VolumesAssistedSnapshotsTest-1084063573-project-member] Lock "55c68a33-6003-4b98-a248-f5d3dafe77f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.333s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:22:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:22:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:54 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:22:54 user nova-compute[75100]: INFO nova.compute.claims [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Claim successful on node user
Nov 13 17:22:55 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:22:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:22:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG nova.policy [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '421484d1f180498fa5e078c084d70986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bd8fd1a36f49a08be3d97799e847a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:22:55 user nova-compute[75100]: INFO nova.virt.block_device [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Booting with volume 2756f150-81ce-420c-9670-d02f76690ef6 at /dev/vda
Nov 13 17:22:55 user nova-compute[75100]: DEBUG os_brick.utils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdf2d5b-6397-4fd6-93dc-dc0fd2c2ea24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[710f331d-285e-4d3a-b657-ed2b584a8579]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a21feb-c58b-4b21-83c1-2846525c2ce6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a476b95-edeb-4922-851b-98034c05fa71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:22:55 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:22:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[84084902-01bc-4692-9cf4-74c6b583c87f]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG os_brick.utils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Updating existing volume attachment record: 4371baa8-db0e-41f3-a675-2a04ac5031af {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:22:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Successfully created port: f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Successfully updated port: f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "refresh_cache-eec9ecbd-569c-46ec-9e74-3160c9ccd39f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquired lock "refresh_cache-eec9ecbd-569c-46ec-9e74-3160c9ccd39f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-a96b5444-f434-4029-af91-6d0053de79fc req-b8d68d2e-ca2d-43d4-a429-df68a9ed49b9 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Received event network-changed-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-a96b5444-f434-4029-af91-6d0053de79fc req-b8d68d2e-ca2d-43d4-a429-df68a9ed49b9 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Refreshing instance network info cache due to event network-changed-f8cb620c-cdc4-4191-ae25-c29a6eb099b0. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a96b5444-f434-4029-af91-6d0053de79fc req-b8d68d2e-ca2d-43d4-a429-df68a9ed49b9 service nova] Acquiring lock "refresh_cache-eec9ecbd-569c-46ec-9e74-3160c9ccd39f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Updating instance_info_cache with network_info: [{"id": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "address": "fa:16:3e:9c:81:1e", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb620c-cd", "ovs_interfaceid": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Releasing lock "refresh_cache-eec9ecbd-569c-46ec-9e74-3160c9ccd39f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Instance network_info: |[{"id": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "address": "fa:16:3e:9c:81:1e", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb620c-cd", "ovs_interfaceid": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a96b5444-f434-4029-af91-6d0053de79fc req-b8d68d2e-ca2d-43d4-a429-df68a9ed49b9 service nova] Acquired lock "refresh_cache-eec9ecbd-569c-46ec-9e74-3160c9ccd39f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:22:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-a96b5444-f434-4029-af91-6d0053de79fc req-b8d68d2e-ca2d-43d4-a429-df68a9ed49b9 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Refreshing network info cache for port f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:22:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:22:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-a96b5444-f434-4029-af91-6d0053de79fc req-b8d68d2e-ca2d-43d4-a429-df68a9ed49b9 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Updated VIF entry in instance network info cache for port f8cb620c-cdc4-4191-ae25-c29a6eb099b0. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:22:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-a96b5444-f434-4029-af91-6d0053de79fc req-b8d68d2e-ca2d-43d4-a429-df68a9ed49b9 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Updating instance_info_cache with network_info: [{"id": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "address": "fa:16:3e:9c:81:1e", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb620c-cd", "ovs_interfaceid": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:22:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a96b5444-f434-4029-af91-6d0053de79fc req-b8d68d2e-ca2d-43d4-a429-df68a9ed49b9 service nova] Releasing lock "refresh_cache-eec9ecbd-569c-46ec-9e74-3160c9ccd39f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:22:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Creating image(s)
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Ensure instance console log exists: /opt/stack/data/nova/instances/eec9ecbd-569c-46ec-9e74-3160c9ccd39f/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Start _get_guest_xml network_info=[{"id": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "address": "fa:16:3e:9c:81:1e", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb620c-cd", "ovs_interfaceid": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '4371baa8-db0e-41f3-a675-2a04ac5031af', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QslwgxEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'eec9ecbd-569c-46ec-9e74-3160c9ccd39f', 'attached_at': '', 'detached_at': '', 'volume_id': '2756f150-81ce-420c-9670-d02f76690ef6', 'serial': '2756f150-81ce-420c-9670-d02f76690ef6'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:22:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:22:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QslwgxEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:22:59 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:59 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:22:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:22:59 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e26df6-3395-4e29-830b-033ab5022f52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:22:59 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[696413fc-5595-47f5-867a-15d48625c646]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6] added
Nov 13 17:22:59 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac9fc68-da82-4a12-9f48-aad0dea5df2a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d253818-c817-44ec-919b-43489942c0be]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QslwgxEG {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QslwgxEG" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46a1415-56b8-4e12-99eb-c2e6cf493424]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QslwgxEG'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:22:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa508ac-b231-4b6c-b459-c4ad7d611c88]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf4ee84-e741-4132-a807-942c884d5dad]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:00 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:00 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ad8c1b-2247-40e2-ae91-ddeb7d9d9a3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6, portal: 172.16.0.220,3260]
Nov 13 17:23:00 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6, portal: 172.16.0.220,3260] successful.
Nov 13 17:23:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64fc9ed-92b2-448b-aa41-8d5dde7ba98e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d597025-ff53-4023-bdf2-c5f709bcb28e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:00 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:00 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:00 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:00 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33bd450-f156-4825-8ba7-7e48ac36c692]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:23:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QslwgxEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23561623366376636', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561623366376636', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:22:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-882964996',display_name='tempest-TestVolumeBootPattern-volume-backed-server-882964996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-882964996',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3nrIQ1ZwEhcXdMKF1A8Fq1zeWahekSwObEL3bvrgNYjzAkS7w9Jo90A8RfjPZMzzaLjtVTn+nkIFee9arV4rZjAFQJoJPJh/CuBCErsgSzgUJDqn5UoMYHiYyOo7b4JQ==',key_name='tempest-keypair-2107698519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-abulzej2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:22:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='421484d1f180498fa5e078c084d70986',uuid=eec9ecbd-569c-46ec-9e74-3160c9ccd39f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "address": "fa:16:3e:9c:81:1e", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb620c-cd", "ovs_interfaceid": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "address": "fa:16:3e:9c:81:1e", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb620c-cd", "ovs_interfaceid": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:81:1e,bridge_name='br-int',has_traffic_filtering=True,id=f8cb620c-cdc4-4191-ae25-c29a6eb099b0,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb620c-cd') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lazy-loading 'pci_devices' on Instance uuid eec9ecbd-569c-46ec-9e74-3160c9ccd39f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:23:01 user nova-compute[75100]:   <uuid>eec9ecbd-569c-46ec-9e74-3160c9ccd39f</uuid>
Nov 13 17:23:01 user nova-compute[75100]:   <name>instance-0000000e</name>
Nov 13 17:23:01 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:23:01 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:23:01 user nova-compute[75100]:   <metadata>
Nov 13 17:23:01 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:23:01 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:23:01 user nova-compute[75100]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-882964996</nova:name>
Nov 13 17:23:01 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:22:59</nova:creationTime>
Nov 13 17:23:01 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:23:01 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:23:01 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:23:01 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:23:01 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:23:01 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:23:01 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:23:01 user nova-compute[75100]:       <nova:owner>
Nov 13 17:23:01 user nova-compute[75100]:         <nova:user uuid="421484d1f180498fa5e078c084d70986">tempest-TestVolumeBootPattern-1156978750-project-member</nova:user>
Nov 13 17:23:01 user nova-compute[75100]:         <nova:project uuid="20bd8fd1a36f49a08be3d97799e847a8">tempest-TestVolumeBootPattern-1156978750</nova:project>
Nov 13 17:23:01 user nova-compute[75100]:       </nova:owner>
Nov 13 17:23:01 user nova-compute[75100]:       <nova:ports>
Nov 13 17:23:01 user nova-compute[75100]:         <nova:port uuid="f8cb620c-cdc4-4191-ae25-c29a6eb099b0">
Nov 13 17:23:01 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 17:23:01 user nova-compute[75100]:         </nova:port>
Nov 13 17:23:01 user nova-compute[75100]:       </nova:ports>
Nov 13 17:23:01 user nova-compute[75100]:     </nova:instance>
Nov 13 17:23:01 user nova-compute[75100]:   </metadata>
Nov 13 17:23:01 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:23:01 user nova-compute[75100]:     <system>
Nov 13 17:23:01 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:23:01 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:23:01 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:23:01 user nova-compute[75100]:       <entry name="serial">eec9ecbd-569c-46ec-9e74-3160c9ccd39f</entry>
Nov 13 17:23:01 user nova-compute[75100]:       <entry name="uuid">eec9ecbd-569c-46ec-9e74-3160c9ccd39f</entry>
Nov 13 17:23:01 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:23:01 user nova-compute[75100]:     </system>
Nov 13 17:23:01 user nova-compute[75100]:   </sysinfo>
Nov 13 17:23:01 user nova-compute[75100]:   <os>
Nov 13 17:23:01 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:23:01 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:23:01 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:23:01 user nova-compute[75100]:   </os>
Nov 13 17:23:01 user nova-compute[75100]:   <features>
Nov 13 17:23:01 user nova-compute[75100]:     <acpi/>
Nov 13 17:23:01 user nova-compute[75100]:     <apic/>
Nov 13 17:23:01 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:23:01 user nova-compute[75100]:   </features>
Nov 13 17:23:01 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:23:01 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:23:01 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:23:01 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:23:01 user nova-compute[75100]:   </clock>
Nov 13 17:23:01 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:23:01 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:23:01 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:23:01 user nova-compute[75100]:   </cpu>
Nov 13 17:23:01 user nova-compute[75100]:   <devices>
Nov 13 17:23:01 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:23:01 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:23:01 user nova-compute[75100]:       <source dev="/dev/sdd"/>
Nov 13 17:23:01 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:23:01 user nova-compute[75100]:       <serial>2756f150-81ce-420c-9670-d02f76690ef6</serial>
Nov 13 17:23:01 user nova-compute[75100]:     </disk>
Nov 13 17:23:01 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:23:01 user nova-compute[75100]:       <mac address="fa:16:3e:9c:81:1e"/>
Nov 13 17:23:01 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:23:01 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:23:01 user nova-compute[75100]:       <target dev="tapf8cb620c-cd"/>
Nov 13 17:23:01 user nova-compute[75100]:     </interface>
Nov 13 17:23:01 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:23:01 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/eec9ecbd-569c-46ec-9e74-3160c9ccd39f/console.log" append="off"/>
Nov 13 17:23:01 user nova-compute[75100]:     </serial>
Nov 13 17:23:01 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:23:01 user nova-compute[75100]:     <video>
Nov 13 17:23:01 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:23:01 user nova-compute[75100]:     </video>
Nov 13 17:23:01 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:23:01 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:23:01 user nova-compute[75100]:     </rng>
Nov 13 17:23:01 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:23:01 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:23:01 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:23:01 user nova-compute[75100]:     </memballoon>
Nov 13 17:23:01 user nova-compute[75100]:   </devices>
Nov 13 17:23:01 user nova-compute[75100]: </domain>
Nov 13 17:23:01 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:22:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-882964996',display_name='tempest-TestVolumeBootPattern-volume-backed-server-882964996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-882964996',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3nrIQ1ZwEhcXdMKF1A8Fq1zeWahekSwObEL3bvrgNYjzAkS7w9Jo90A8RfjPZMzzaLjtVTn+nkIFee9arV4rZjAFQJoJPJh/CuBCErsgSzgUJDqn5UoMYHiYyOo7b4JQ==',key_name='tempest-keypair-2107698519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-abulzej2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:22:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='421484d1f180498fa5e078c084d70986',uuid=eec9ecbd-569c-46ec-9e74-3160c9ccd39f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "address": "fa:16:3e:9c:81:1e", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb620c-cd", "ovs_interfaceid": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "address": "fa:16:3e:9c:81:1e", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb620c-cd", "ovs_interfaceid": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:81:1e,bridge_name='br-int',has_traffic_filtering=True,id=f8cb620c-cdc4-4191-ae25-c29a6eb099b0,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb620c-cd') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG os_vif [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:81:1e,bridge_name='br-int',has_traffic_filtering=True,id=f8cb620c-cdc4-4191-ae25-c29a6eb099b0,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb620c-cd') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dce19e94-4430-54f8-8b6b-5076e60fee63', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8cb620c-cd, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8cb620c-cd, col_values=(('qos', UUID('c7a04f13-6b32-493f-82d1-4123feddf5a7')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8cb620c-cd, col_values=(('external_ids', {'iface-id': 'f8cb620c-cdc4-4191-ae25-c29a6eb099b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:81:1e', 'vm-uuid': 'eec9ecbd-569c-46ec-9e74-3160c9ccd39f'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:01 user nova-compute[75100]: INFO os_vif [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:81:1e,bridge_name='br-int',has_traffic_filtering=True,id=f8cb620c-cdc4-4191-ae25-c29a6eb099b0,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb620c-cd')
Nov 13 17:23:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:23:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] No VIF found with MAC fa:16:3e:9c:81:1e, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:23:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-91111940-0ae2-42c8-844d-24d405408a2a req-96c44909-22e7-46bb-8c78-107193d71ec2 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Received event network-vif-plugged-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-91111940-0ae2-42c8-844d-24d405408a2a req-96c44909-22e7-46bb-8c78-107193d71ec2 service nova] Acquiring lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-91111940-0ae2-42c8-844d-24d405408a2a req-96c44909-22e7-46bb-8c78-107193d71ec2 service nova] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-91111940-0ae2-42c8-844d-24d405408a2a req-96c44909-22e7-46bb-8c78-107193d71ec2 service nova] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-91111940-0ae2-42c8-844d-24d405408a2a req-96c44909-22e7-46bb-8c78-107193d71ec2 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] No waiting events found dispatching network-vif-plugged-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:03 user nova-compute[75100]: WARNING nova.compute.manager [req-91111940-0ae2-42c8-844d-24d405408a2a req-96c44909-22e7-46bb-8c78-107193d71ec2 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Received unexpected event network-vif-plugged-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 for instance with vm_state building and task_state spawning.
Nov 13 17:23:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:23:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Instance spawned successfully.
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-b56ad1ef-30df-4b1e-84e6-35bfcbf9b720 req-1e8822a9-0795-411d-be02-75c25e5c63b6 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Received event network-vif-plugged-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b56ad1ef-30df-4b1e-84e6-35bfcbf9b720 req-1e8822a9-0795-411d-be02-75c25e5c63b6 service nova] Acquiring lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b56ad1ef-30df-4b1e-84e6-35bfcbf9b720 req-1e8822a9-0795-411d-be02-75c25e5c63b6 service nova] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b56ad1ef-30df-4b1e-84e6-35bfcbf9b720 req-1e8822a9-0795-411d-be02-75c25e5c63b6 service nova] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-b56ad1ef-30df-4b1e-84e6-35bfcbf9b720 req-1e8822a9-0795-411d-be02-75c25e5c63b6 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] No waiting events found dispatching network-vif-plugged-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:05 user nova-compute[75100]: WARNING nova.compute.manager [req-b56ad1ef-30df-4b1e-84e6-35bfcbf9b720 req-1e8822a9-0795-411d-be02-75c25e5c63b6 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Received unexpected event network-vif-plugged-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 for instance with vm_state building and task_state spawning.
Nov 13 17:23:05 user nova-compute[75100]: INFO nova.compute.manager [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:05 user nova-compute[75100]: INFO nova.compute.manager [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Terminating instance
Nov 13 17:23:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:23:05 user nova-compute[75100]: INFO nova.compute.manager [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Took 10.39 seconds to build instance.
Nov 13 17:23:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0573371e-416c-47f2-9807-de4915e5d8d9 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.496s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Instance destroyed successfully.
Nov 13 17:23:06 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lazy-loading 'resources' on Instance uuid d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1325451567',display_name='tempest-TestVolumeSwap-server-1325451567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1325451567',id=7,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmLA/YJAMaL+GKdFe0GdhCPRpSy0iZUDfY4Vw0MV3iqhmilf1aJqud9w+Rmvkrsrl8nTlEnsCgh88bx9PVVBS8asPE8m4rLQMpou59Yv67lan7RQRnYUSHHRN38sqJiIQ==',key_name='tempest-keypair-920829371',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:20:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3f2a4991fba445f8c8092a7575c7480',ramdisk_id='',reservation_id='r-n808uex1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-732461591',owner_user_name='tempest-TestVolumeSwap-732461591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f4f73d50c8d6444a8781e92683eeba00',uuid=d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "address": "fa:16:3e:3e:c6:e4", "network": {"id": "f70775c3-a96e-44f5-88b8-e6d63ee78d51", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257528124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f2a4991fba445f8c8092a7575c7480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17b414e0-be", "ovs_interfaceid": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Converting VIF {"id": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "address": "fa:16:3e:3e:c6:e4", "network": {"id": "f70775c3-a96e-44f5-88b8-e6d63ee78d51", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1257528124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3f2a4991fba445f8c8092a7575c7480", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17b414e0-be", "ovs_interfaceid": "17b414e0-be01-45df-9ae4-0a9be2c8b4cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=17b414e0-be01-45df-9ae4-0a9be2c8b4cd,network=Network(f70775c3-a96e-44f5-88b8-e6d63ee78d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17b414e0-be') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG os_vif [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=17b414e0-be01-45df-9ae4-0a9be2c8b4cd,network=Network(f70775c3-a96e-44f5-88b8-e6d63ee78d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17b414e0-be') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17b414e0-be, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c28c6c54-45dd-4f33-9376-eeafd64960cb) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:06 user nova-compute[75100]: INFO os_vif [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:c6:e4,bridge_name='br-int',has_traffic_filtering=True,id=17b414e0-be01-45df-9ae4-0a9be2c8b4cd,network=Network(f70775c3-a96e-44f5-88b8-e6d63ee78d51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17b414e0-be')
Nov 13 17:23:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Deleting instance files /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f_del
Nov 13 17:23:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Deletion of /opt/stack/data/nova/instances/d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f_del complete
Nov 13 17:23:06 user nova-compute[75100]: INFO nova.compute.manager [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 13 17:23:06 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:23:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:07 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Took 0.87 seconds to deallocate network for instance.
Nov 13 17:23:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-31a9dc8d-f5a9-43c5-a9ec-242df8a517c4 req-9e62f155-66ce-4020-bb05-ecf94c82e1a6 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Received event network-vif-deleted-17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:07 user nova-compute[75100]: INFO nova.compute.manager [req-31a9dc8d-f5a9-43c5-a9ec-242df8a517c4 req-9e62f155-66ce-4020-bb05-ecf94c82e1a6 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Neutron deleted interface 17b414e0-be01-45df-9ae4-0a9be2c8b4cd; detaching it from the instance and deleting it from the info cache
Nov 13 17:23:07 user nova-compute[75100]: DEBUG nova.network.neutron [req-31a9dc8d-f5a9-43c5-a9ec-242df8a517c4 req-9e62f155-66ce-4020-bb05-ecf94c82e1a6 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-31a9dc8d-f5a9-43c5-a9ec-242df8a517c4 req-9e62f155-66ce-4020-bb05-ecf94c82e1a6 service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Detach interface failed, port_id=17b414e0-be01-45df-9ae4-0a9be2c8b4cd, reason: Instance d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-9f62fbb1-bda4-4ac2-8a4f-eb05051943bc req-de049071-b45b-433e-aec7-f51845bfc8ac service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Received event network-vif-unplugged-17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9f62fbb1-bda4-4ac2-8a4f-eb05051943bc req-de049071-b45b-433e-aec7-f51845bfc8ac service nova] Acquiring lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9f62fbb1-bda4-4ac2-8a4f-eb05051943bc req-de049071-b45b-433e-aec7-f51845bfc8ac service nova] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9f62fbb1-bda4-4ac2-8a4f-eb05051943bc req-de049071-b45b-433e-aec7-f51845bfc8ac service nova] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-9f62fbb1-bda4-4ac2-8a4f-eb05051943bc req-de049071-b45b-433e-aec7-f51845bfc8ac service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] No waiting events found dispatching network-vif-unplugged-17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-9f62fbb1-bda4-4ac2-8a4f-eb05051943bc req-de049071-b45b-433e-aec7-f51845bfc8ac service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Received event network-vif-unplugged-17b414e0-be01-45df-9ae4-0a9be2c8b4cd for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-9f62fbb1-bda4-4ac2-8a4f-eb05051943bc req-de049071-b45b-433e-aec7-f51845bfc8ac service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Received event network-vif-plugged-17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9f62fbb1-bda4-4ac2-8a4f-eb05051943bc req-de049071-b45b-433e-aec7-f51845bfc8ac service nova] Acquiring lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9f62fbb1-bda4-4ac2-8a4f-eb05051943bc req-de049071-b45b-433e-aec7-f51845bfc8ac service nova] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9f62fbb1-bda4-4ac2-8a4f-eb05051943bc req-de049071-b45b-433e-aec7-f51845bfc8ac service nova] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-9f62fbb1-bda4-4ac2-8a4f-eb05051943bc req-de049071-b45b-433e-aec7-f51845bfc8ac service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] No waiting events found dispatching network-vif-plugged-17b414e0-be01-45df-9ae4-0a9be2c8b4cd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:07 user nova-compute[75100]: WARNING nova.compute.manager [req-9f62fbb1-bda4-4ac2-8a4f-eb05051943bc req-de049071-b45b-433e-aec7-f51845bfc8ac service nova] [instance: d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f] Received unexpected event network-vif-plugged-17b414e0-be01-45df-9ae4-0a9be2c8b4cd for instance with vm_state active and task_state deleting.
Nov 13 17:23:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:23:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:07 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Deleted allocations for instance d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f
Nov 13 17:23:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d9e2cbd2-65e8-4f3c-bf64-d0de3e5b5971 tempest-TestVolumeSwap-732461591 tempest-TestVolumeSwap-732461591-project-member] Lock "d88fd6b4-8e19-4b0a-a6d4-761187cd3c0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.472s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lazy-loading 'flavor' on Instance uuid 64c9f78b-8ce5-4328-9fb0-93715df6135f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:23:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:14 user nova-compute[75100]: INFO nova.compute.manager [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Attaching volume 5bb32c0e-ed04-4dc9-b83c-805371205ba4 to /dev/vdb
Nov 13 17:23:14 user nova-compute[75100]: DEBUG os_brick.utils [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a5ce96-307b-43d7-adb1-cc075eebf4e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5844f8e1-5520-4433-9439-293d7bf89e5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9ac145-1b55-4218-817b-3abf25491c40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c111923-9895-4ec3-9c6c-b04b8b604f26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:23:14 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cac794-0fb5-4631-ab10-80083e485eb1]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG os_brick.utils [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating existing volume attachment record: 00e57e5d-e0c6-4775-9665-57692584203a {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:23:14 user nova-compute[75100]: INFO nova.compute.claims [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Claim successful on node user
Nov 13 17:23:15 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:23:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:23:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG nova.policy [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ea28cc48696459f96e7ad8dacad33da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119dde6420324f52a165a5610c77d1c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:23:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Creating image(s)
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "/opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "/opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "/opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.221s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk 1073741824" returned: 0 in 0.055s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Successfully created port: f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Cannot resize image /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Ensure instance console log exists: /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Successfully updated port: f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "refresh_cache-5933add2-b8bb-448d-a054-d8527e3c49f8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquired lock "refresh_cache-5933add2-b8bb-448d-a054-d8527e3c49f8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-a0d1ee92-08d1-4eda-9f47-ef707f014adc req-d13a7b9c-fa29-4637-a34f-196864e29cf4 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received event network-changed-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-a0d1ee92-08d1-4eda-9f47-ef707f014adc req-d13a7b9c-fa29-4637-a34f-196864e29cf4 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Refreshing instance network info cache due to event network-changed-f3f52df4-25c5-4c98-9a0c-76093617c180. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:23:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a0d1ee92-08d1-4eda-9f47-ef707f014adc req-d13a7b9c-fa29-4637-a34f-196864e29cf4 service nova] Acquiring lock "refresh_cache-5933add2-b8bb-448d-a054-d8527e3c49f8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Updating instance_info_cache with network_info: [{"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Releasing lock "refresh_cache-5933add2-b8bb-448d-a054-d8527e3c49f8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Instance network_info: |[{"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a0d1ee92-08d1-4eda-9f47-ef707f014adc req-d13a7b9c-fa29-4637-a34f-196864e29cf4 service nova] Acquired lock "refresh_cache-5933add2-b8bb-448d-a054-d8527e3c49f8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-a0d1ee92-08d1-4eda-9f47-ef707f014adc req-d13a7b9c-fa29-4637-a34f-196864e29cf4 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Refreshing network info cache for port f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Start _get_guest_xml network_info=[{"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:23:17 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:23:17 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:23:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-33132177',display_name='tempest-tempest.common.compute-instance-33132177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-33132177',id=15,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbFY5LgKRXl7mG8F4M+9+fbhr2HSsopYQvyoxkqIHaLSDggJc3195H3FH3yXGej6QMVhX0ugpcyjD2elnXP0l/zvIcBGJ/8nBKUf7xPxcXKw5IKnnG2QtFINn4u/nqf7w==',key_name='tempest-keypair-558257575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-8y9r17uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:23:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=5933add2-b8bb-448d-a054-d8527e3c49f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lazy-loading 'pci_devices' on Instance uuid 5933add2-b8bb-448d-a054-d8527e3c49f8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:23:17 user nova-compute[75100]:   <uuid>5933add2-b8bb-448d-a054-d8527e3c49f8</uuid>
Nov 13 17:23:17 user nova-compute[75100]:   <name>instance-0000000f</name>
Nov 13 17:23:17 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:23:17 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:23:17 user nova-compute[75100]:   <metadata>
Nov 13 17:23:17 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:23:17 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:23:17 user nova-compute[75100]:       <nova:name>tempest-tempest.common.compute-instance-33132177</nova:name>
Nov 13 17:23:17 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:23:17</nova:creationTime>
Nov 13 17:23:17 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:23:17 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:23:17 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:23:17 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:23:17 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:23:17 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:23:17 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:23:17 user nova-compute[75100]:       <nova:owner>
Nov 13 17:23:17 user nova-compute[75100]:         <nova:user uuid="7ea28cc48696459f96e7ad8dacad33da">tempest-ServerActionsTestOtherA-226710821-project-member</nova:user>
Nov 13 17:23:17 user nova-compute[75100]:         <nova:project uuid="119dde6420324f52a165a5610c77d1c3">tempest-ServerActionsTestOtherA-226710821</nova:project>
Nov 13 17:23:17 user nova-compute[75100]:       </nova:owner>
Nov 13 17:23:17 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:23:17 user nova-compute[75100]:       <nova:ports>
Nov 13 17:23:17 user nova-compute[75100]:         <nova:port uuid="f3f52df4-25c5-4c98-9a0c-76093617c180">
Nov 13 17:23:17 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 17:23:17 user nova-compute[75100]:         </nova:port>
Nov 13 17:23:17 user nova-compute[75100]:       </nova:ports>
Nov 13 17:23:17 user nova-compute[75100]:     </nova:instance>
Nov 13 17:23:17 user nova-compute[75100]:   </metadata>
Nov 13 17:23:17 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:23:17 user nova-compute[75100]:     <system>
Nov 13 17:23:17 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:23:17 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:23:17 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:23:17 user nova-compute[75100]:       <entry name="serial">5933add2-b8bb-448d-a054-d8527e3c49f8</entry>
Nov 13 17:23:17 user nova-compute[75100]:       <entry name="uuid">5933add2-b8bb-448d-a054-d8527e3c49f8</entry>
Nov 13 17:23:17 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:23:17 user nova-compute[75100]:     </system>
Nov 13 17:23:17 user nova-compute[75100]:   </sysinfo>
Nov 13 17:23:17 user nova-compute[75100]:   <os>
Nov 13 17:23:17 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:23:17 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:23:17 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:23:17 user nova-compute[75100]:   </os>
Nov 13 17:23:17 user nova-compute[75100]:   <features>
Nov 13 17:23:17 user nova-compute[75100]:     <acpi/>
Nov 13 17:23:17 user nova-compute[75100]:     <apic/>
Nov 13 17:23:17 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:23:17 user nova-compute[75100]:   </features>
Nov 13 17:23:17 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:23:17 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:23:17 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:23:17 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:23:17 user nova-compute[75100]:   </clock>
Nov 13 17:23:17 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:23:17 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:23:17 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:23:17 user nova-compute[75100]:   </cpu>
Nov 13 17:23:17 user nova-compute[75100]:   <devices>
Nov 13 17:23:17 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:23:17 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:23:17 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk"/>
Nov 13 17:23:17 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:23:17 user nova-compute[75100]:     </disk>
Nov 13 17:23:17 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:23:17 user nova-compute[75100]:       <mac address="fa:16:3e:d4:ef:78"/>
Nov 13 17:23:17 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:23:17 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:23:17 user nova-compute[75100]:       <target dev="tapf3f52df4-25"/>
Nov 13 17:23:17 user nova-compute[75100]:     </interface>
Nov 13 17:23:17 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:23:17 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/console.log" append="off"/>
Nov 13 17:23:17 user nova-compute[75100]:     </serial>
Nov 13 17:23:17 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:23:17 user nova-compute[75100]:     <video>
Nov 13 17:23:17 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:23:17 user nova-compute[75100]:     </video>
Nov 13 17:23:17 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:23:17 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:23:17 user nova-compute[75100]:     </rng>
Nov 13 17:23:17 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:23:17 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:23:17 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:23:17 user nova-compute[75100]:     </memballoon>
Nov 13 17:23:17 user nova-compute[75100]:   </devices>
Nov 13 17:23:17 user nova-compute[75100]: </domain>
Nov 13 17:23:17 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:23:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-33132177',display_name='tempest-tempest.common.compute-instance-33132177',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-33132177',id=15,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbFY5LgKRXl7mG8F4M+9+fbhr2HSsopYQvyoxkqIHaLSDggJc3195H3FH3yXGej6QMVhX0ugpcyjD2elnXP0l/zvIcBGJ/8nBKUf7xPxcXKw5IKnnG2QtFINn4u/nqf7w==',key_name='tempest-keypair-558257575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-8y9r17uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:23:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=5933add2-b8bb-448d-a054-d8527e3c49f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG os_vif [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9886d19f-f13e-5964-afd1-3a522e21e0cf', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3f52df4-25, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3f52df4-25, col_values=(('qos', UUID('6554e373-e26a-49ef-bbdb-ebbd3378e70c')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3f52df4-25, col_values=(('external_ids', {'iface-id': 'f3f52df4-25c5-4c98-9a0c-76093617c180', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:ef:78', 'vm-uuid': '5933add2-b8bb-448d-a054-d8527e3c49f8'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:17 user nova-compute[75100]: INFO os_vif [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25')
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No VIF found with MAC fa:16:3e:d4:ef:78, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-a0d1ee92-08d1-4eda-9f47-ef707f014adc req-d13a7b9c-fa29-4637-a34f-196864e29cf4 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Updated VIF entry in instance network info cache for port f3f52df4-25c5-4c98-9a0c-76093617c180. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-a0d1ee92-08d1-4eda-9f47-ef707f014adc req-d13a7b9c-fa29-4637-a34f-196864e29cf4 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Updating instance_info_cache with network_info: [{"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a0d1ee92-08d1-4eda-9f47-ef707f014adc req-d13a7b9c-fa29-4637-a34f-196864e29cf4 service nova] Releasing lock "refresh_cache-5933add2-b8bb-448d-a054-d8527e3c49f8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:23:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:23:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:23:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:23:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-7b225788-7cdc-4057-9aba-c2d24b3f4719 req-a8541f62-f79d-4e60-82e3-ead320035da4 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received event network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7b225788-7cdc-4057-9aba-c2d24b3f4719 req-a8541f62-f79d-4e60-82e3-ead320035da4 service nova] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7b225788-7cdc-4057-9aba-c2d24b3f4719 req-a8541f62-f79d-4e60-82e3-ead320035da4 service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7b225788-7cdc-4057-9aba-c2d24b3f4719 req-a8541f62-f79d-4e60-82e3-ead320035da4 service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-7b225788-7cdc-4057-9aba-c2d24b3f4719 req-a8541f62-f79d-4e60-82e3-ead320035da4 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] No waiting events found dispatching network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:19 user nova-compute[75100]: WARNING nova.compute.manager [req-7b225788-7cdc-4057-9aba-c2d24b3f4719 req-a8541f62-f79d-4e60-82e3-ead320035da4 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received unexpected event network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 for instance with vm_state building and task_state spawning.
Nov 13 17:23:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEVWivnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:23:19 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:23:19 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:23:19 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260" returned: 21 in 0.176s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd90997-42ea-4e9a-a036-1f3bca6e62ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:23:19 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c765f5-ea99-4ac7-a716-68be8609da41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4] added
Nov 13 17:23:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c14d52a-f591-41c4-8e1a-626f0045778c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c6d98d-b2e3-4c11-a9b9-482f3bcc28c5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEVWivnO {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEVWivnO" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[523aa582-1105-4175-b081-1479e51e581c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yEVWivnO'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[68356d4b-81fe-41d1-b311-379b5ec76cef]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c130f7c-4bb6-4367-b698-ec74b1ac316c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:19 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:19 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:19 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:19 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:23:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1357282b-b5be-4711-af27-4c3547c642c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260]
Nov 13 17:23:20 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260] successful.
Nov 13 17:23:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b886059d-1c56-4dc9-a1b4-c77a37bb149c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b840a86c-2a97-44e4-bee1-78899a54e99a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:20 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:20 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:20 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:23:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:20 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:20 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:20 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:23:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.582s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.038s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8f96db-5bdf-485a-9b8c-7e5e849836eb]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEVWivnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Updating instance_info_cache with network_info: [{"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.642s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] <== connect_volume: return (1647ms) {'type': 'block', 'scsi_wwn': '23230646434323839', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230646434323839', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.objects.instance [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lazy-loading 'flavor' on Instance uuid 64c9f78b-8ce5-4328-9fb0-93715df6135f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:23:21 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:23:21 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 13 17:23:21 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:23:21 user nova-compute[75100]:   <serial>5bb32c0e-ed04-4dc9-b83c-805371205ba4</serial>
Nov 13 17:23:21 user nova-compute[75100]: </disk>
Nov 13 17:23:21 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-66ec1949-10f2-4ec0-a98e-f0d85e8f7ea5 req-8bfc13d8-b752-4a0f-8a72-3d3e3cba684b service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received event network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-66ec1949-10f2-4ec0-a98e-f0d85e8f7ea5 req-8bfc13d8-b752-4a0f-8a72-3d3e3cba684b service nova] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-66ec1949-10f2-4ec0-a98e-f0d85e8f7ea5 req-8bfc13d8-b752-4a0f-8a72-3d3e3cba684b service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-66ec1949-10f2-4ec0-a98e-f0d85e8f7ea5 req-8bfc13d8-b752-4a0f-8a72-3d3e3cba684b service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-66ec1949-10f2-4ec0-a98e-f0d85e8f7ea5 req-8bfc13d8-b752-4a0f-8a72-3d3e3cba684b service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] No waiting events found dispatching network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:21 user nova-compute[75100]: WARNING nova.compute.manager [req-66ec1949-10f2-4ec0-a98e-f0d85e8f7ea5 req-8bfc13d8-b752-4a0f-8a72-3d3e3cba684b service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received unexpected event network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 for instance with vm_state building and task_state spawning.
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] No VIF found with MAC fa:16:3e:f0:3f:b9, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24054d28-5007-4a13-a625-d50fea384d11 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.704s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:23:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Instance spawned successfully.
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:22 user nova-compute[75100]: INFO nova.compute.manager [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Took 6.70 seconds to spawn the instance on the hypervisor.
Nov 13 17:23:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:22 user nova-compute[75100]: INFO nova.compute.manager [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Took 7.65 seconds to build instance.
Nov 13 17:23:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b88d706-e18b-4259-ac68-869b3270a8f7 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.779s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:23:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8012MB free_disk=25.531856536865234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.009s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:24 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating resource usage from migration bc3c4381-3f11-4c13-b9ef-868e809b1c3c
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 64c9f78b-8ce5-4328-9fb0-93715df6135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 5ead8372-787b-41f8-95cc-11dd49093606 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance eec9ecbd-569c-46ec-9e74-3160c9ccd39f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 5933add2-b8bb-448d-a054-d8527e3c49f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:23:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Stashing vm_state: active {{(pid=75100) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 13 17:23:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:23:25 user nova-compute[75100]: INFO nova.compute.claims [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Claim successful on node user
Nov 13 17:23:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:25 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating resource usage from migration bc3c4381-3f11-4c13-b9ef-868e809b1c3c
Nov 13 17:23:25 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:23:25 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:23:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.448s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:25 user nova-compute[75100]: INFO nova.compute.manager [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Migrating
Nov 13 17:23:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:23:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:23:25 user nova-compute[75100]: INFO nova.compute.rpcapi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 13 17:23:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:23:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:23:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquired lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:23:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:23:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating instance_info_cache with network_info: [{"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Releasing lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:23:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Starting migrate_disk_and_power_off {{(pid=75100) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 13 17:23:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:27 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Instance destroyed successfully.
Nov 13 17:23:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1879098934',display_name='tempest-ServerActionsTestOtherB-server-1879098934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1879098934',id=6,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtAAW3TgTxHf+TUITy0Mmc2phtGIX31UWPLC6Ax00Ra3rvR7rorviHUXMJmTRs8r7vW2IjeukFIO8Ah6Z/JWvZwng0Wq3UlZJ7OxB5Mha2gh4q+d5taNiDQoe9oXIHuA==',key_name='tempest-keypair-2067438742',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1fa1230bfae049af9ce657d6889eddad',ramdisk_id='',reservation_id='r-78tnxuif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1067719084',owner_user_name='tempest-ServerActionsTestOtherB-1067719084-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:23:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='047fae6bc2134ea2a43fb06dbeabbb0b',uuid=64c9f78b-8ce5-4328-9fb0-93715df6135f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30287792-network", "vif_mac": "fa:16:3e:f0:3f:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converting VIF {"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30287792-network", "vif_mac": "fa:16:3e:f0:3f:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_vif [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d8ea93b-b6, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e528be09-02e3-4808-9577-8872206e3a0d) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:27 user nova-compute[75100]: INFO os_vif [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6')
Nov 13 17:23:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEVWivnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:23:27 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa386f2-27e2-41b8-a9b0-3bc225b8c9bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:23:27 user nova-compute[75100]: No targets found.
Nov 13 17:23:27 user nova-compute[75100]: iSNS:
Nov 13 17:23:27 user nova-compute[75100]: No targets found.
Nov 13 17:23:27 user nova-compute[75100]: STATIC:
Nov 13 17:23:27 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4
Nov 13 17:23:27 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:23:27 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:23:27 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:23:27 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:23:27 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:23:27 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6
Nov 13 17:23:27 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:23:27 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:23:27 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b
Nov 13 17:23:27 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:23:27 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:23:27 user nova-compute[75100]: FIRMWARE:
Nov 13 17:23:27 user nova-compute[75100]: No targets found.
Nov 13 17:23:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:23:27 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:23:27 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a771ee-f4b1-4773-bd46-62a8808e4dec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b711abfc-8d8a-49f8-9bc8-3e725fd20d94]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:27 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:27 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:27 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:23:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:27 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:27 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:27 user nova-compute[75100]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:23:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38d11630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecabb31-a5e0-4901-a19b-e1c451acceff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a224f8-aab6-4bbb-a422-3546fd62f9fd]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b03017-b1d1-482f-91e7-ed0f864cc0eb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8122db87-b4ed-4c6c-9e48-1e4d3f57b4ab]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9a46ae-3644-48a5-a85b-83cf4d49f502]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[466d4bd9-b996-4368-9805-6b25af2cb5b5]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260]
Nov 13 17:23:27 user nova-compute[75100]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260] successful.
Nov 13 17:23:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a546cc2-a210-4778-b897-703a8b5b7ec0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] <== disconnect_volume: return (346ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:23:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:23:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f_resize/disk /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CMD "cp -r /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f_resize/disk /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk" returned: 0 in 0.340s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f_resize/disk.info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk.info {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CMD "cp -r /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f_resize/disk.info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk.info" returned: 0 in 0.034s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Port 4d8ea93b-b607-4f22-ad01-9577465b5997 binding to destination host user is already ACTIVE {{(pid=75100) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 17:23:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:23:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquired lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:23:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:23:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating instance_info_cache with network_info: [{"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Releasing lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG os_brick.utils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0610ba-ba0e-410b-b51d-8558142a4929]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[637d9596-7732-4b8b-b925-6a5eb4a1fd20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b9887c-4b7f-463f-b2f4-d00a5a234cc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e389d342-6edd-4b5c-8a2f-aa13a650f9ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:23:31 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e54cbdb-e3b1-4e80-927f-431026522bd2]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG os_brick.utils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-a01241c8-ce66-42a4-bbec-4ab7ded5abc2 req-5eb433e6-cd19-40a0-9a1e-25f393bdadab service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-unplugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a01241c8-ce66-42a4-bbec-4ab7ded5abc2 req-5eb433e6-cd19-40a0-9a1e-25f393bdadab service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a01241c8-ce66-42a4-bbec-4ab7ded5abc2 req-5eb433e6-cd19-40a0-9a1e-25f393bdadab service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a01241c8-ce66-42a4-bbec-4ab7ded5abc2 req-5eb433e6-cd19-40a0-9a1e-25f393bdadab service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-a01241c8-ce66-42a4-bbec-4ab7ded5abc2 req-5eb433e6-cd19-40a0-9a1e-25f393bdadab service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-unplugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:31 user nova-compute[75100]: WARNING nova.compute.manager [req-a01241c8-ce66-42a4-bbec-4ab7ded5abc2 req-5eb433e6-cd19-40a0-9a1e-25f393bdadab service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-unplugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state active and task_state resize_finish.
Nov 13 17:23:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-13c4435a-5fcb-45cf-a4f9-89df57dda669 req-fec952a8-96a4-4e57-be04-09c7bb2dff9e service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-13c4435a-5fcb-45cf-a4f9-89df57dda669 req-fec952a8-96a4-4e57-be04-09c7bb2dff9e service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-13c4435a-5fcb-45cf-a4f9-89df57dda669 req-fec952a8-96a4-4e57-be04-09c7bb2dff9e service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-13c4435a-5fcb-45cf-a4f9-89df57dda669 req-fec952a8-96a4-4e57-be04-09c7bb2dff9e service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-13c4435a-5fcb-45cf-a4f9-89df57dda669 req-fec952a8-96a4-4e57-be04-09c7bb2dff9e service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:33 user nova-compute[75100]: WARNING nova.compute.manager [req-13c4435a-5fcb-45cf-a4f9-89df57dda669 req-fec952a8-96a4-4e57-be04-09c7bb2dff9e service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state active and task_state resize_finish.
Nov 13 17:23:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Starting finish_migration {{(pid=75100) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 17:23:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Creating image(s)
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:23:36 user nova-compute[75100]: INFO nova.compute.claims [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Claim successful on node user
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk. size=21474836480 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk 21474836480 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk 21474836480" returned: 0 in 0.058s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Ensure instance console log exists: /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Start _get_guest_xml network_info=[{"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30287792-network", "vif_mac": "fa:16:3e:f0:3f:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'dde072fd-c216-413b-8fa1-3f40c4ac7469', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEVWivnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '64c9f78b-8ce5-4328-9fb0-93715df6135f', 'attached_at': '2023-11-13T17:23:36.000000', 'detached_at': '', 'volume_id': '5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'serial': '5bb32c0e-ed04-4dc9-b83c-805371205ba4'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:23:36 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:23:36 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEVWivnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:23:36 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:23:36 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:23:36 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f716d631-0619-4926-8b39-777652d7d6b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:23:36 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c10133-8658-4484-bf90-c81fff2d8176]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4] added
Nov 13 17:23:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abf8048-4170-4060-813d-5b70bd842d29]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a472f2d-f3da-4565-bd9f-f1a6eda87489]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEVWivnO {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEVWivnO" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[122804a4-afd7-4498-8d28-91f234c01150]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yEVWivnO'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[136ca80a-600c-4b10-82a7-081dbe6ec7e4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.network.neutron [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac429b1-9bce-40b2-b348-247e35e75949]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:36 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:36 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:36 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:36 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d55c173-b3cf-493f-a932-6d1ea5773acb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260]
Nov 13 17:23:36 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260] successful.
Nov 13 17:23:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.policy [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bb17b2fc6a4406ca5c476d267ff6f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6052793c6f6e40ce9f63a04a0afd609f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef445e46-f670-4834-b354-8a79f514c13a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9a8392-6db3-430e-a37f-2ab84e800b56]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:36 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:36 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:36 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:23:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:36 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:36 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:36 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:23:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:23:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Creating image(s)
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "/opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "/opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "/opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f053543-500b-4619-a05a-ab2307a98061]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEVWivnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:23:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk 1073741824" returned: 0 in 0.078s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG nova.network.neutron [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Successfully created port: 311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Cannot resize image /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Ensure instance console log exists: /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23230646434323839', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:23:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230646434323839', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1879098934',display_name='tempest-ServerActionsTestOtherB-server-1879098934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1879098934',id=6,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtAAW3TgTxHf+TUITy0Mmc2phtGIX31UWPLC6Ax00Ra3rvR7rorviHUXMJmTRs8r7vW2IjeukFIO8Ah6Z/JWvZwng0Wq3UlZJ7OxB5Mha2gh4q+d5taNiDQoe9oXIHuA==',key_name='tempest-keypair-2067438742',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1fa1230bfae049af9ce657d6889eddad',ramdisk_id='',reservation_id='r-78tnxuif',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1067719084',owner_user_name='tempest-ServerActionsTestOtherB-1067719084-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:23:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='047fae6bc2134ea2a43fb06dbeabbb0b',uuid=64c9f78b-8ce5-4328-9fb0-93715df6135f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30287792-network", "vif_mac": "fa:16:3e:f0:3f:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converting VIF {"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30287792-network", "vif_mac": "fa:16:3e:f0:3f:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:23:38 user nova-compute[75100]:   <uuid>64c9f78b-8ce5-4328-9fb0-93715df6135f</uuid>
Nov 13 17:23:38 user nova-compute[75100]:   <name>instance-00000006</name>
Nov 13 17:23:38 user nova-compute[75100]:   <memory>2097152</memory>
Nov 13 17:23:38 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:23:38 user nova-compute[75100]:   <metadata>
Nov 13 17:23:38 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:23:38 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:23:38 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherB-server-1879098934</nova:name>
Nov 13 17:23:38 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:23:36</nova:creationTime>
Nov 13 17:23:38 user nova-compute[75100]:       <nova:flavor name="m1.small">
Nov 13 17:23:38 user nova-compute[75100]:         <nova:memory>2048</nova:memory>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:disk>20</nova:disk>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:23:38 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:23:38 user nova-compute[75100]:       <nova:owner>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:user uuid="047fae6bc2134ea2a43fb06dbeabbb0b">tempest-ServerActionsTestOtherB-1067719084-project-member</nova:user>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:project uuid="1fa1230bfae049af9ce657d6889eddad">tempest-ServerActionsTestOtherB-1067719084</nova:project>
Nov 13 17:23:38 user nova-compute[75100]:       </nova:owner>
Nov 13 17:23:38 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:23:38 user nova-compute[75100]:       <nova:ports>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:port uuid="4d8ea93b-b607-4f22-ad01-9577465b5997">
Nov 13 17:23:38 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:23:38 user nova-compute[75100]:         </nova:port>
Nov 13 17:23:38 user nova-compute[75100]:       </nova:ports>
Nov 13 17:23:38 user nova-compute[75100]:     </nova:instance>
Nov 13 17:23:38 user nova-compute[75100]:   </metadata>
Nov 13 17:23:38 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:23:38 user nova-compute[75100]:     <system>
Nov 13 17:23:38 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:23:38 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:23:38 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:23:38 user nova-compute[75100]:       <entry name="serial">64c9f78b-8ce5-4328-9fb0-93715df6135f</entry>
Nov 13 17:23:38 user nova-compute[75100]:       <entry name="uuid">64c9f78b-8ce5-4328-9fb0-93715df6135f</entry>
Nov 13 17:23:38 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:23:38 user nova-compute[75100]:     </system>
Nov 13 17:23:38 user nova-compute[75100]:   </sysinfo>
Nov 13 17:23:38 user nova-compute[75100]:   <os>
Nov 13 17:23:38 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:23:38 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:23:38 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:23:38 user nova-compute[75100]:   </os>
Nov 13 17:23:38 user nova-compute[75100]:   <features>
Nov 13 17:23:38 user nova-compute[75100]:     <acpi/>
Nov 13 17:23:38 user nova-compute[75100]:     <apic/>
Nov 13 17:23:38 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:23:38 user nova-compute[75100]:   </features>
Nov 13 17:23:38 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:23:38 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:23:38 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:23:38 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:23:38 user nova-compute[75100]:   </clock>
Nov 13 17:23:38 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:23:38 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:23:38 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:23:38 user nova-compute[75100]:   </cpu>
Nov 13 17:23:38 user nova-compute[75100]:   <devices>
Nov 13 17:23:38 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:23:38 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:23:38 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk"/>
Nov 13 17:23:38 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:23:38 user nova-compute[75100]:     </disk>
Nov 13 17:23:38 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:23:38 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:23:38 user nova-compute[75100]:       <source dev="/dev/sde"/>
Nov 13 17:23:38 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:23:38 user nova-compute[75100]:       <serial>5bb32c0e-ed04-4dc9-b83c-805371205ba4</serial>
Nov 13 17:23:38 user nova-compute[75100]:     </disk>
Nov 13 17:23:38 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:23:38 user nova-compute[75100]:       <mac address="fa:16:3e:f0:3f:b9"/>
Nov 13 17:23:38 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:23:38 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:23:38 user nova-compute[75100]:       <target dev="tap4d8ea93b-b6"/>
Nov 13 17:23:38 user nova-compute[75100]:     </interface>
Nov 13 17:23:38 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:23:38 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/console.log" append="off"/>
Nov 13 17:23:38 user nova-compute[75100]:     </serial>
Nov 13 17:23:38 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:23:38 user nova-compute[75100]:     <video>
Nov 13 17:23:38 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:23:38 user nova-compute[75100]:     </video>
Nov 13 17:23:38 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:23:38 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:23:38 user nova-compute[75100]:     </rng>
Nov 13 17:23:38 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:23:38 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:23:38 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:23:38 user nova-compute[75100]:     </memballoon>
Nov 13 17:23:38 user nova-compute[75100]:   </devices>
Nov 13 17:23:38 user nova-compute[75100]: </domain>
Nov 13 17:23:38 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1879098934',display_name='tempest-ServerActionsTestOtherB-server-1879098934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1879098934',id=6,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtAAW3TgTxHf+TUITy0Mmc2phtGIX31UWPLC6Ax00Ra3rvR7rorviHUXMJmTRs8r7vW2IjeukFIO8Ah6Z/JWvZwng0Wq3UlZJ7OxB5Mha2gh4q+d5taNiDQoe9oXIHuA==',key_name='tempest-keypair-2067438742',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1fa1230bfae049af9ce657d6889eddad',ramdisk_id='',reservation_id='r-78tnxuif',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1067719084',owner_user_name='tempest-ServerActionsTestOtherB-1067719084-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:23:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='047fae6bc2134ea2a43fb06dbeabbb0b',uuid=64c9f78b-8ce5-4328-9fb0-93715df6135f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30287792-network", "vif_mac": "fa:16:3e:f0:3f:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converting VIF {"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-30287792-network", "vif_mac": "fa:16:3e:f0:3f:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG os_vif [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48e89590-f317-5f0c-a697-dcd434c33537', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d8ea93b-b6, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d8ea93b-b6, col_values=(('qos', UUID('2f8e6381-389d-447e-842d-4ac4d1b3f114')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d8ea93b-b6, col_values=(('external_ids', {'iface-id': '4d8ea93b-b607-4f22-ad01-9577465b5997', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:3f:b9', 'vm-uuid': '64c9f78b-8ce5-4328-9fb0-93715df6135f'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: INFO os_vif [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6')
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] No VIF found with MAC fa:16:3e:f0:3f:b9, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Successfully updated port: 311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "refresh_cache-e96eb705-85e2-4cce-a91d-5d319b1b5083" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquired lock "refresh_cache-e96eb705-85e2-4cce-a91d-5d319b1b5083" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-65020e21-a717-4f10-81ce-18b09aea2425 req-06f24e66-5347-4a3c-b5f8-79ddb60df6fb service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Received event network-changed-311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-65020e21-a717-4f10-81ce-18b09aea2425 req-06f24e66-5347-4a3c-b5f8-79ddb60df6fb service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Refreshing instance network info cache due to event network-changed-311b11cf-67e8-42ac-9166-8b24a7fb5238. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-65020e21-a717-4f10-81ce-18b09aea2425 req-06f24e66-5347-4a3c-b5f8-79ddb60df6fb service nova] Acquiring lock "refresh_cache-e96eb705-85e2-4cce-a91d-5d319b1b5083" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Updating instance_info_cache with network_info: [{"id": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "address": "fa:16:3e:d0:59:f9", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap311b11cf-67", "ovs_interfaceid": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Releasing lock "refresh_cache-e96eb705-85e2-4cce-a91d-5d319b1b5083" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Instance network_info: |[{"id": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "address": "fa:16:3e:d0:59:f9", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap311b11cf-67", "ovs_interfaceid": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-65020e21-a717-4f10-81ce-18b09aea2425 req-06f24e66-5347-4a3c-b5f8-79ddb60df6fb service nova] Acquired lock "refresh_cache-e96eb705-85e2-4cce-a91d-5d319b1b5083" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.neutron [req-65020e21-a717-4f10-81ce-18b09aea2425 req-06f24e66-5347-4a3c-b5f8-79ddb60df6fb service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Refreshing network info cache for port 311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Start _get_guest_xml network_info=[{"id": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "address": "fa:16:3e:d0:59:f9", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap311b11cf-67", "ovs_interfaceid": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:23:38 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:23:38 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:23:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-97358362',display_name='tempest-VolumesAdminNegativeTest-server-97358362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-97358362',id=16,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHL5a3YI/CmgPPsCouyA7NlKHC1NxiJh4anyfyDfNM56tkGOuMF5kazL4+p4HvT67Cj6W+UKd9dcj5/H46LjJnoFW3gMemNJKGHup0QqcQdLuriHrmxBnSD1H2EDil82Kg==',key_name='tempest-keypair-65749873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6052793c6f6e40ce9f63a04a0afd609f',ramdisk_id='',reservation_id='r-4mnmvr6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-57814532',owner_user_name='tempest-VolumesAdminNegativeTest-57814532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:23:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb17b2fc6a4406ca5c476d267ff6f2a',uuid=e96eb705-85e2-4cce-a91d-5d319b1b5083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "address": "fa:16:3e:d0:59:f9", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap311b11cf-67", "ovs_interfaceid": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Converting VIF {"id": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "address": "fa:16:3e:d0:59:f9", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap311b11cf-67", "ovs_interfaceid": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:59:f9,bridge_name='br-int',has_traffic_filtering=True,id=311b11cf-67e8-42ac-9166-8b24a7fb5238,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap311b11cf-67') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lazy-loading 'pci_devices' on Instance uuid e96eb705-85e2-4cce-a91d-5d319b1b5083 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:23:38 user nova-compute[75100]:   <uuid>e96eb705-85e2-4cce-a91d-5d319b1b5083</uuid>
Nov 13 17:23:38 user nova-compute[75100]:   <name>instance-00000010</name>
Nov 13 17:23:38 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:23:38 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:23:38 user nova-compute[75100]:   <metadata>
Nov 13 17:23:38 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:23:38 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:23:38 user nova-compute[75100]:       <nova:name>tempest-VolumesAdminNegativeTest-server-97358362</nova:name>
Nov 13 17:23:38 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:23:38</nova:creationTime>
Nov 13 17:23:38 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:23:38 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:23:38 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:23:38 user nova-compute[75100]:       <nova:owner>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:user uuid="4bb17b2fc6a4406ca5c476d267ff6f2a">tempest-VolumesAdminNegativeTest-57814532-project-member</nova:user>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:project uuid="6052793c6f6e40ce9f63a04a0afd609f">tempest-VolumesAdminNegativeTest-57814532</nova:project>
Nov 13 17:23:38 user nova-compute[75100]:       </nova:owner>
Nov 13 17:23:38 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:23:38 user nova-compute[75100]:       <nova:ports>
Nov 13 17:23:38 user nova-compute[75100]:         <nova:port uuid="311b11cf-67e8-42ac-9166-8b24a7fb5238">
Nov 13 17:23:38 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 17:23:38 user nova-compute[75100]:         </nova:port>
Nov 13 17:23:38 user nova-compute[75100]:       </nova:ports>
Nov 13 17:23:38 user nova-compute[75100]:     </nova:instance>
Nov 13 17:23:38 user nova-compute[75100]:   </metadata>
Nov 13 17:23:38 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:23:38 user nova-compute[75100]:     <system>
Nov 13 17:23:38 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:23:38 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:23:38 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:23:38 user nova-compute[75100]:       <entry name="serial">e96eb705-85e2-4cce-a91d-5d319b1b5083</entry>
Nov 13 17:23:38 user nova-compute[75100]:       <entry name="uuid">e96eb705-85e2-4cce-a91d-5d319b1b5083</entry>
Nov 13 17:23:38 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:23:38 user nova-compute[75100]:     </system>
Nov 13 17:23:38 user nova-compute[75100]:   </sysinfo>
Nov 13 17:23:38 user nova-compute[75100]:   <os>
Nov 13 17:23:38 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:23:38 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:23:38 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:23:38 user nova-compute[75100]:   </os>
Nov 13 17:23:38 user nova-compute[75100]:   <features>
Nov 13 17:23:38 user nova-compute[75100]:     <acpi/>
Nov 13 17:23:38 user nova-compute[75100]:     <apic/>
Nov 13 17:23:38 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:23:38 user nova-compute[75100]:   </features>
Nov 13 17:23:38 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:23:38 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:23:38 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:23:38 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:23:38 user nova-compute[75100]:   </clock>
Nov 13 17:23:38 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:23:38 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:23:38 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:23:38 user nova-compute[75100]:   </cpu>
Nov 13 17:23:38 user nova-compute[75100]:   <devices>
Nov 13 17:23:38 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:23:38 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:23:38 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk"/>
Nov 13 17:23:38 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:23:38 user nova-compute[75100]:     </disk>
Nov 13 17:23:38 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:23:38 user nova-compute[75100]:       <mac address="fa:16:3e:d0:59:f9"/>
Nov 13 17:23:38 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:23:38 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:23:38 user nova-compute[75100]:       <target dev="tap311b11cf-67"/>
Nov 13 17:23:38 user nova-compute[75100]:     </interface>
Nov 13 17:23:38 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:23:38 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/console.log" append="off"/>
Nov 13 17:23:38 user nova-compute[75100]:     </serial>
Nov 13 17:23:38 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:23:38 user nova-compute[75100]:     <video>
Nov 13 17:23:38 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:23:38 user nova-compute[75100]:     </video>
Nov 13 17:23:38 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:23:38 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:23:38 user nova-compute[75100]:     </rng>
Nov 13 17:23:38 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:23:38 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:23:38 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:23:38 user nova-compute[75100]:     </memballoon>
Nov 13 17:23:38 user nova-compute[75100]:   </devices>
Nov 13 17:23:38 user nova-compute[75100]: </domain>
Nov 13 17:23:38 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:23:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-97358362',display_name='tempest-VolumesAdminNegativeTest-server-97358362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-97358362',id=16,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHL5a3YI/CmgPPsCouyA7NlKHC1NxiJh4anyfyDfNM56tkGOuMF5kazL4+p4HvT67Cj6W+UKd9dcj5/H46LjJnoFW3gMemNJKGHup0QqcQdLuriHrmxBnSD1H2EDil82Kg==',key_name='tempest-keypair-65749873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6052793c6f6e40ce9f63a04a0afd609f',ramdisk_id='',reservation_id='r-4mnmvr6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-57814532',owner_user_name='tempest-VolumesAdminNegativeTest-57814532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:23:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb17b2fc6a4406ca5c476d267ff6f2a',uuid=e96eb705-85e2-4cce-a91d-5d319b1b5083,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "address": "fa:16:3e:d0:59:f9", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap311b11cf-67", "ovs_interfaceid": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Converting VIF {"id": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "address": "fa:16:3e:d0:59:f9", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap311b11cf-67", "ovs_interfaceid": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:59:f9,bridge_name='br-int',has_traffic_filtering=True,id=311b11cf-67e8-42ac-9166-8b24a7fb5238,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap311b11cf-67') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG os_vif [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:59:f9,bridge_name='br-int',has_traffic_filtering=True,id=311b11cf-67e8-42ac-9166-8b24a7fb5238,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap311b11cf-67') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f83cde40-a8cd-575d-b030-a1b049eef7b6', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap311b11cf-67, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap311b11cf-67, col_values=(('qos', UUID('5ccd6aec-78e9-4cc3-bb2b-588a423f209f')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap311b11cf-67, col_values=(('external_ids', {'iface-id': '311b11cf-67e8-42ac-9166-8b24a7fb5238', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:59:f9', 'vm-uuid': 'e96eb705-85e2-4cce-a91d-5d319b1b5083'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:38 user nova-compute[75100]: INFO os_vif [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:59:f9,bridge_name='br-int',has_traffic_filtering=True,id=311b11cf-67e8-42ac-9166-8b24a7fb5238,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap311b11cf-67')
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:23:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] No VIF found with MAC fa:16:3e:d0:59:f9, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:23:39 user nova-compute[75100]: DEBUG nova.network.neutron [req-65020e21-a717-4f10-81ce-18b09aea2425 req-06f24e66-5347-4a3c-b5f8-79ddb60df6fb service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Updated VIF entry in instance network info cache for port 311b11cf-67e8-42ac-9166-8b24a7fb5238. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:23:39 user nova-compute[75100]: DEBUG nova.network.neutron [req-65020e21-a717-4f10-81ce-18b09aea2425 req-06f24e66-5347-4a3c-b5f8-79ddb60df6fb service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Updating instance_info_cache with network_info: [{"id": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "address": "fa:16:3e:d0:59:f9", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap311b11cf-67", "ovs_interfaceid": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-65020e21-a717-4f10-81ce-18b09aea2425 req-06f24e66-5347-4a3c-b5f8-79ddb60df6fb service nova] Releasing lock "refresh_cache-e96eb705-85e2-4cce-a91d-5d319b1b5083" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:23:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-e6c4774b-b8d8-4d87-934e-a306e9aabf05 req-9491e796-4784-4088-b805-e9510749e37a service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e6c4774b-b8d8-4d87-934e-a306e9aabf05 req-9491e796-4784-4088-b805-e9510749e37a service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e6c4774b-b8d8-4d87-934e-a306e9aabf05 req-9491e796-4784-4088-b805-e9510749e37a service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e6c4774b-b8d8-4d87-934e-a306e9aabf05 req-9491e796-4784-4088-b805-e9510749e37a service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-e6c4774b-b8d8-4d87-934e-a306e9aabf05 req-9491e796-4784-4088-b805-e9510749e37a service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:40 user nova-compute[75100]: WARNING nova.compute.manager [req-e6c4774b-b8d8-4d87-934e-a306e9aabf05 req-9491e796-4784-4088-b805-e9510749e37a service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state active and task_state resize_finish.
Nov 13 17:23:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:42 user nova-compute[75100]: WARNING nova.compute.manager [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state active and task_state resize_finish.
Nov 13 17:23:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Received event network-vif-plugged-311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] Acquiring lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] No waiting events found dispatching network-vif-plugged-311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:42 user nova-compute[75100]: WARNING nova.compute.manager [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Received unexpected event network-vif-plugged-311b11cf-67e8-42ac-9166-8b24a7fb5238 for instance with vm_state building and task_state spawning.
Nov 13 17:23:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Received event network-vif-plugged-311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] Acquiring lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] No waiting events found dispatching network-vif-plugged-311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:42 user nova-compute[75100]: WARNING nova.compute.manager [req-2e571b48-8c08-467f-9df3-f9e1aa45c9b2 req-e6badaeb-5086-4bf4-ad2d-55d0e47b4b2d service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Received unexpected event network-vif-plugged-311b11cf-67e8-42ac-9166-8b24a7fb5238 for instance with vm_state building and task_state spawning.
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "5ead8372-787b-41f8-95cc-11dd49093606" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:42 user nova-compute[75100]: INFO nova.compute.manager [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Terminating instance
Nov 13 17:23:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:23:43 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Instance running successfully.
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Failed to set time: agent not configured {{(pid=75100) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8eeaef3c-f852-496a-b937-9babff993ee1 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] finish_migration finished successfully. {{(pid=75100) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:43 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Instance destroyed successfully.
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.objects.instance [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lazy-loading 'resources' on Instance uuid 5ead8372-787b-41f8-95cc-11dd49093606 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:19:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-434015320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-716596890',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMMHrvy6dRXfrXCI4JiaUSDCttbmdw96JfvW+n8ZiGKpKZMjmLzpK9h3eR71xlPMzcT2ZyjL7UJxtt2DhdOyrObd8ECbbaG5NFmjMFIEU9X7Qc7cQ7GuxVyy0CTzRSvdWw==',key_name='tempest-keypair-203724816',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:22:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec5af88d50944bbd9e6ec2ae84f194d2',ramdisk_id='',reservation_id='r-yqh7vk1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1979706355',owner_user_name='tempest-ServerActionsV293TestJSON-1979706355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:22:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f56979d0e374f6ea4be1920f5f62fd9',uuid=5ead8372-787b-41f8-95cc-11dd49093606,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Converting VIF {"id": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "address": "fa:16:3e:dd:2b:2b", "network": {"id": "ab9d6d8e-41a3-4803-9081-323173b1ca95", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-283398694-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5af88d50944bbd9e6ec2ae84f194d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc364a290-68", "ovs_interfaceid": "c364a290-68a0-4e5c-9865-a9b19620f0d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_vif [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc364a290-68, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f72004c-db06-43e4-8afc-a905608e13e0) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:43 user nova-compute[75100]: INFO os_vif [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c364a290-68a0-4e5c-9865-a9b19620f0d1,network=Network(ab9d6d8e-41a3-4803-9081-323173b1ca95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc364a290-68')
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XHOtjDqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:23:43 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[050418f4-1a47-4239-b5c0-d037db1cdd1a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:23:43 user nova-compute[75100]: No targets found.
Nov 13 17:23:43 user nova-compute[75100]: iSNS:
Nov 13 17:23:43 user nova-compute[75100]: No targets found.
Nov 13 17:23:43 user nova-compute[75100]: STATIC:
Nov 13 17:23:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4
Nov 13 17:23:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:23:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:23:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:23:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:23:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:23:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6
Nov 13 17:23:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:23:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:23:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b
Nov 13 17:23:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:23:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:23:43 user nova-compute[75100]: FIRMWARE:
Nov 13 17:23:43 user nova-compute[75100]: No targets found.
Nov 13 17:23:43 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:23:43 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:23:43 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.039s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[22856959-4d48-444a-8d94-c262ad27f0aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[99027da8-d611-4f1e-94d6-7c877ed2a3d9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:43 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:43 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:43 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:23:43 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b (non-flash)
Nov 13 17:23:43 user nova-compute[75100]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:23:43 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:23:43 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:23:43 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38d035b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:23:43 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Instance spawned successfully.
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e287a7c7-f61e-4e51-9fe0-748177dd201a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1585a2ea-1cd1-4ccb-93d7-1b675fc58d57]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef7c31d-de08-4d1e-948a-6cb633cf6a54]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2945d6ef-dad6-4ab6-a59e-8a7900e40cce]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b146a103-54ad-48a9-b691-d99b685e1e8e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:43 user nova-compute[75100]: INFO nova.compute.manager [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Took 6.79 seconds to spawn the instance on the hypervisor.
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2fe471-fc86-412e-817a-5dab93df0375]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260]
Nov 13 17:23:43 user nova-compute[75100]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b, portal: 172.16.0.220,3260] successful.
Nov 13 17:23:43 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c111e555-d452-4770-b8c7-853575a07b0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef84707-6d36-4849-ab3e-dc6198abbf6d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] <== disconnect_volume: return (448ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:23:43 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Deleting instance files /opt/stack/data/nova/instances/5ead8372-787b-41f8-95cc-11dd49093606_del
Nov 13 17:23:43 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Deletion of /opt/stack/data/nova/instances/5ead8372-787b-41f8-95cc-11dd49093606_del complete
Nov 13 17:23:43 user nova-compute[75100]: INFO nova.compute.manager [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Took 7.88 seconds to build instance.
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-75da9a3a-80b6-4bd7-b15d-0dc5e2e40c0c tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.026s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:43 user nova-compute[75100]: INFO nova.compute.manager [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Took 1.41 seconds to destroy the instance on the hypervisor.
Nov 13 17:23:43 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:23:43 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-unplugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] No waiting events found dispatching network-vif-unplugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-unplugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] No waiting events found dispatching network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:44 user nova-compute[75100]: WARNING nova.compute.manager [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received unexpected event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 for instance with vm_state active and task_state deleting.
Nov 13 17:23:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] No waiting events found dispatching network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:44 user nova-compute[75100]: WARNING nova.compute.manager [req-c46d55a7-d35a-4b10-910e-51011a0044a7 req-81cdfad7-3c07-419a-8ab1-dca23cb3a4e4 service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received unexpected event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 for instance with vm_state active and task_state deleting.
Nov 13 17:23:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:45 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:45 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Took 1.19 seconds to deallocate network for instance.
Nov 13 17:23:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-3265f3be-9f4a-4d32-8873-1a7f5dffb007 req-f9f1605c-4fa5-4543-b3a5-07d206c0bf0c service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-deleted-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:45 user nova-compute[75100]: INFO nova.compute.manager [req-3265f3be-9f4a-4d32-8873-1a7f5dffb007 req-f9f1605c-4fa5-4543-b3a5-07d206c0bf0c service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Neutron deleted interface c364a290-68a0-4e5c-9865-a9b19620f0d1; detaching it from the instance and deleting it from the info cache
Nov 13 17:23:45 user nova-compute[75100]: DEBUG nova.network.neutron [req-3265f3be-9f4a-4d32-8873-1a7f5dffb007 req-f9f1605c-4fa5-4543-b3a5-07d206c0bf0c service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-3265f3be-9f4a-4d32-8873-1a7f5dffb007 req-f9f1605c-4fa5-4543-b3a5-07d206c0bf0c service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Detach interface failed, port_id=c364a290-68a0-4e5c-9865-a9b19620f0d1, reason: Instance 5ead8372-787b-41f8-95cc-11dd49093606 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:23:45 user nova-compute[75100]: INFO nova.compute.manager [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Took 0.86 seconds to detach 1 volumes for instance.
Nov 13 17:23:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Deleting volume: c111e555-d452-4770-b8c7-853575a07b0b {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] No waiting events found dispatching network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:46 user nova-compute[75100]: WARNING nova.compute.manager [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received unexpected event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 for instance with vm_state deleted and task_state None.
Nov 13 17:23:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-unplugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] No waiting events found dispatching network-vif-unplugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:46 user nova-compute[75100]: WARNING nova.compute.manager [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received unexpected event network-vif-unplugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 for instance with vm_state deleted and task_state None.
Nov 13 17:23:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] Acquiring lock "5ead8372-787b-41f8-95cc-11dd49093606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] Lock "5ead8372-787b-41f8-95cc-11dd49093606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] No waiting events found dispatching network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:46 user nova-compute[75100]: WARNING nova.compute.manager [req-12c09bbc-dfaf-4d1d-946c-bb8463d5f20f req-b4d1dd7e-8378-48c0-bd18-ad1d9f164b7e service nova] [instance: 5ead8372-787b-41f8-95cc-11dd49093606] Received unexpected event network-vif-plugged-c364a290-68a0-4e5c-9865-a9b19620f0d1 for instance with vm_state deleted and task_state None.
Nov 13 17:23:46 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:46 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Deleted allocations for instance 5ead8372-787b-41f8-95cc-11dd49093606
Nov 13 17:23:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-69d23051-09f4-4c26-a6f3-c983da6cfd67 tempest-ServerActionsV293TestJSON-1979706355 tempest-ServerActionsV293TestJSON-1979706355-project-member] Lock "5ead8372-787b-41f8-95cc-11dd49093606" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.336s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Acquiring lock "aefb432b-20b8-4c65-afd1-5ae501b80b43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:23:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:23:51 user nova-compute[75100]: INFO nova.compute.claims [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Claim successful on node user
Nov 13 17:23:51 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:23:51 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:23:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:23:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:23:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:23:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:23:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:23:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Creating image(s)
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Acquiring lock "/opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "/opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "/opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG nova.policy [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4def479d50d45bca64f521baf63659a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebb206190184bbbaeb0374709a23db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk 1073741824" returned: 0 in 0.051s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Successfully created port: 47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Cannot resize image /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Ensure instance console log exists: /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Successfully updated port: 47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Acquiring lock "refresh_cache-aefb432b-20b8-4c65-afd1-5ae501b80b43" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Acquired lock "refresh_cache-aefb432b-20b8-4c65-afd1-5ae501b80b43" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-74ef80a5-9c1f-4424-99d0-27bcb1586edc req-0ccda43e-2ac5-44ce-8fa7-a8dd79b02454 service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Received event network-changed-47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-74ef80a5-9c1f-4424-99d0-27bcb1586edc req-0ccda43e-2ac5-44ce-8fa7-a8dd79b02454 service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Refreshing instance network info cache due to event network-changed-47696d52-ff5d-4d45-98a7-4eb625245cd6. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74ef80a5-9c1f-4424-99d0-27bcb1586edc req-0ccda43e-2ac5-44ce-8fa7-a8dd79b02454 service nova] Acquiring lock "refresh_cache-aefb432b-20b8-4c65-afd1-5ae501b80b43" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Updating instance_info_cache with network_info: [{"id": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "address": "fa:16:3e:0b:0d:65", "network": {"id": "434a6557-6cf1-4e57-876a-9847d13b383d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "458e9f65fc7f403d89d88b277a17b562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47696d52-ff", "ovs_interfaceid": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Releasing lock "refresh_cache-aefb432b-20b8-4c65-afd1-5ae501b80b43" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Instance network_info: |[{"id": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "address": "fa:16:3e:0b:0d:65", "network": {"id": "434a6557-6cf1-4e57-876a-9847d13b383d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "458e9f65fc7f403d89d88b277a17b562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47696d52-ff", "ovs_interfaceid": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74ef80a5-9c1f-4424-99d0-27bcb1586edc req-0ccda43e-2ac5-44ce-8fa7-a8dd79b02454 service nova] Acquired lock "refresh_cache-aefb432b-20b8-4c65-afd1-5ae501b80b43" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-74ef80a5-9c1f-4424-99d0-27bcb1586edc req-0ccda43e-2ac5-44ce-8fa7-a8dd79b02454 service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Refreshing network info cache for port 47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Start _get_guest_xml network_info=[{"id": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "address": "fa:16:3e:0b:0d:65", "network": {"id": "434a6557-6cf1-4e57-876a-9847d13b383d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "458e9f65fc7f403d89d88b277a17b562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47696d52-ff", "ovs_interfaceid": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:23:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:23:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:23:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1041673190',display_name='tempest-VolumesNegativeTest-instance-1041673190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1041673190',id=17,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ebb206190184bbbaeb0374709a23db3',ramdisk_id='',reservation_id='r-5gisqron',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-769849930',owner_user_name='tempest-VolumesNegativeTest-769849930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:23:52Z,user_data=None,user_id='a4def479d50d45bca64f521baf63659a',uuid=aefb432b-20b8-4c65-afd1-5ae501b80b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "address": "fa:16:3e:0b:0d:65", "network": {"id": "434a6557-6cf1-4e57-876a-9847d13b383d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "458e9f65fc7f403d89d88b277a17b562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47696d52-ff", "ovs_interfaceid": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Converting VIF {"id": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "address": "fa:16:3e:0b:0d:65", "network": {"id": "434a6557-6cf1-4e57-876a-9847d13b383d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "458e9f65fc7f403d89d88b277a17b562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47696d52-ff", "ovs_interfaceid": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0d:65,bridge_name='br-int',has_traffic_filtering=True,id=47696d52-ff5d-4d45-98a7-4eb625245cd6,network=Network(434a6557-6cf1-4e57-876a-9847d13b383d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47696d52-ff') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lazy-loading 'pci_devices' on Instance uuid aefb432b-20b8-4c65-afd1-5ae501b80b43 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:23:53 user nova-compute[75100]:   <uuid>aefb432b-20b8-4c65-afd1-5ae501b80b43</uuid>
Nov 13 17:23:53 user nova-compute[75100]:   <name>instance-00000011</name>
Nov 13 17:23:53 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:23:53 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:23:53 user nova-compute[75100]:   <metadata>
Nov 13 17:23:53 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:23:53 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:23:53 user nova-compute[75100]:       <nova:name>tempest-VolumesNegativeTest-instance-1041673190</nova:name>
Nov 13 17:23:53 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:23:53</nova:creationTime>
Nov 13 17:23:53 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:23:53 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:23:53 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:23:53 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:23:53 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:23:53 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:23:53 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:23:53 user nova-compute[75100]:       <nova:owner>
Nov 13 17:23:53 user nova-compute[75100]:         <nova:user uuid="a4def479d50d45bca64f521baf63659a">tempest-VolumesNegativeTest-769849930-project-member</nova:user>
Nov 13 17:23:53 user nova-compute[75100]:         <nova:project uuid="5ebb206190184bbbaeb0374709a23db3">tempest-VolumesNegativeTest-769849930</nova:project>
Nov 13 17:23:53 user nova-compute[75100]:       </nova:owner>
Nov 13 17:23:53 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:23:53 user nova-compute[75100]:       <nova:ports>
Nov 13 17:23:53 user nova-compute[75100]:         <nova:port uuid="47696d52-ff5d-4d45-98a7-4eb625245cd6">
Nov 13 17:23:53 user nova-compute[75100]:           <nova:ip type="fixed" address="192.168.233.89" ipVersion="4"/>
Nov 13 17:23:53 user nova-compute[75100]:         </nova:port>
Nov 13 17:23:53 user nova-compute[75100]:       </nova:ports>
Nov 13 17:23:53 user nova-compute[75100]:     </nova:instance>
Nov 13 17:23:53 user nova-compute[75100]:   </metadata>
Nov 13 17:23:53 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:23:53 user nova-compute[75100]:     <system>
Nov 13 17:23:53 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:23:53 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:23:53 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:23:53 user nova-compute[75100]:       <entry name="serial">aefb432b-20b8-4c65-afd1-5ae501b80b43</entry>
Nov 13 17:23:53 user nova-compute[75100]:       <entry name="uuid">aefb432b-20b8-4c65-afd1-5ae501b80b43</entry>
Nov 13 17:23:53 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:23:53 user nova-compute[75100]:     </system>
Nov 13 17:23:53 user nova-compute[75100]:   </sysinfo>
Nov 13 17:23:53 user nova-compute[75100]:   <os>
Nov 13 17:23:53 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:23:53 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:23:53 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:23:53 user nova-compute[75100]:   </os>
Nov 13 17:23:53 user nova-compute[75100]:   <features>
Nov 13 17:23:53 user nova-compute[75100]:     <acpi/>
Nov 13 17:23:53 user nova-compute[75100]:     <apic/>
Nov 13 17:23:53 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:23:53 user nova-compute[75100]:   </features>
Nov 13 17:23:53 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:23:53 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:23:53 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:23:53 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:23:53 user nova-compute[75100]:   </clock>
Nov 13 17:23:53 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:23:53 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:23:53 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:23:53 user nova-compute[75100]:   </cpu>
Nov 13 17:23:53 user nova-compute[75100]:   <devices>
Nov 13 17:23:53 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:23:53 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:23:53 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk"/>
Nov 13 17:23:53 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:23:53 user nova-compute[75100]:     </disk>
Nov 13 17:23:53 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:23:53 user nova-compute[75100]:       <mac address="fa:16:3e:0b:0d:65"/>
Nov 13 17:23:53 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:23:53 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:23:53 user nova-compute[75100]:       <target dev="tap47696d52-ff"/>
Nov 13 17:23:53 user nova-compute[75100]:     </interface>
Nov 13 17:23:53 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:23:53 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/console.log" append="off"/>
Nov 13 17:23:53 user nova-compute[75100]:     </serial>
Nov 13 17:23:53 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:23:53 user nova-compute[75100]:     <video>
Nov 13 17:23:53 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:23:53 user nova-compute[75100]:     </video>
Nov 13 17:23:53 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:23:53 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:23:53 user nova-compute[75100]:     </rng>
Nov 13 17:23:53 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:23:53 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:23:53 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:23:53 user nova-compute[75100]:     </memballoon>
Nov 13 17:23:53 user nova-compute[75100]:   </devices>
Nov 13 17:23:53 user nova-compute[75100]: </domain>
Nov 13 17:23:53 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:23:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1041673190',display_name='tempest-VolumesNegativeTest-instance-1041673190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1041673190',id=17,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ebb206190184bbbaeb0374709a23db3',ramdisk_id='',reservation_id='r-5gisqron',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-769849930',owner_user_name='tempest-VolumesNegativeTest-769849930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:23:52Z,user_data=None,user_id='a4def479d50d45bca64f521baf63659a',uuid=aefb432b-20b8-4c65-afd1-5ae501b80b43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "address": "fa:16:3e:0b:0d:65", "network": {"id": "434a6557-6cf1-4e57-876a-9847d13b383d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "458e9f65fc7f403d89d88b277a17b562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47696d52-ff", "ovs_interfaceid": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Converting VIF {"id": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "address": "fa:16:3e:0b:0d:65", "network": {"id": "434a6557-6cf1-4e57-876a-9847d13b383d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "458e9f65fc7f403d89d88b277a17b562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47696d52-ff", "ovs_interfaceid": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0d:65,bridge_name='br-int',has_traffic_filtering=True,id=47696d52-ff5d-4d45-98a7-4eb625245cd6,network=Network(434a6557-6cf1-4e57-876a-9847d13b383d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47696d52-ff') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG os_vif [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0d:65,bridge_name='br-int',has_traffic_filtering=True,id=47696d52-ff5d-4d45-98a7-4eb625245cd6,network=Network(434a6557-6cf1-4e57-876a-9847d13b383d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47696d52-ff') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49581298-30ea-5a74-b2b2-69a6c3d70787', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47696d52-ff, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47696d52-ff, col_values=(('qos', UUID('88c80767-41a5-43ed-96ac-97f3c4afd95e')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47696d52-ff, col_values=(('external_ids', {'iface-id': '47696d52-ff5d-4d45-98a7-4eb625245cd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:0d:65', 'vm-uuid': 'aefb432b-20b8-4c65-afd1-5ae501b80b43'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:23:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:53 user nova-compute[75100]: INFO os_vif [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0d:65,bridge_name='br-int',has_traffic_filtering=True,id=47696d52-ff5d-4d45-98a7-4eb625245cd6,network=Network(434a6557-6cf1-4e57-876a-9847d13b383d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47696d52-ff')
Nov 13 17:23:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:23:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] No VIF found with MAC fa:16:3e:0b:0d:65, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:23:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-74ef80a5-9c1f-4424-99d0-27bcb1586edc req-0ccda43e-2ac5-44ce-8fa7-a8dd79b02454 service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Updated VIF entry in instance network info cache for port 47696d52-ff5d-4d45-98a7-4eb625245cd6. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:23:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-74ef80a5-9c1f-4424-99d0-27bcb1586edc req-0ccda43e-2ac5-44ce-8fa7-a8dd79b02454 service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Updating instance_info_cache with network_info: [{"id": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "address": "fa:16:3e:0b:0d:65", "network": {"id": "434a6557-6cf1-4e57-876a-9847d13b383d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "458e9f65fc7f403d89d88b277a17b562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47696d52-ff", "ovs_interfaceid": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:23:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74ef80a5-9c1f-4424-99d0-27bcb1586edc req-0ccda43e-2ac5-44ce-8fa7-a8dd79b02454 service nova] Releasing lock "refresh_cache-aefb432b-20b8-4c65-afd1-5ae501b80b43" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:23:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-4a1fddde-1794-403e-9775-42414da70343 req-754061a4-96fa-4782-a360-4d16889d38a2 service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Received event network-vif-plugged-47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4a1fddde-1794-403e-9775-42414da70343 req-754061a4-96fa-4782-a360-4d16889d38a2 service nova] Acquiring lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4a1fddde-1794-403e-9775-42414da70343 req-754061a4-96fa-4782-a360-4d16889d38a2 service nova] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4a1fddde-1794-403e-9775-42414da70343 req-754061a4-96fa-4782-a360-4d16889d38a2 service nova] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-4a1fddde-1794-403e-9775-42414da70343 req-754061a4-96fa-4782-a360-4d16889d38a2 service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] No waiting events found dispatching network-vif-plugged-47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:56 user nova-compute[75100]: WARNING nova.compute.manager [req-4a1fddde-1794-403e-9775-42414da70343 req-754061a4-96fa-4782-a360-4d16889d38a2 service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Received unexpected event network-vif-plugged-47696d52-ff5d-4d45-98a7-4eb625245cd6 for instance with vm_state building and task_state spawning.
Nov 13 17:23:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:23:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:23:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:23:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Instance spawned successfully.
Nov 13 17:23:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:23:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:23:58 user nova-compute[75100]: INFO nova.compute.manager [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 13 17:23:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:23:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-f9c31ca6-fbfa-4d50-a40f-4dbf07a179ff req-9f6be3b3-55c4-458d-8f17-c586d042ab20 service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Received event network-vif-plugged-47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:23:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f9c31ca6-fbfa-4d50-a40f-4dbf07a179ff req-9f6be3b3-55c4-458d-8f17-c586d042ab20 service nova] Acquiring lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:23:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f9c31ca6-fbfa-4d50-a40f-4dbf07a179ff req-9f6be3b3-55c4-458d-8f17-c586d042ab20 service nova] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:23:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f9c31ca6-fbfa-4d50-a40f-4dbf07a179ff req-9f6be3b3-55c4-458d-8f17-c586d042ab20 service nova] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-f9c31ca6-fbfa-4d50-a40f-4dbf07a179ff req-9f6be3b3-55c4-458d-8f17-c586d042ab20 service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] No waiting events found dispatching network-vif-plugged-47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:23:58 user nova-compute[75100]: WARNING nova.compute.manager [req-f9c31ca6-fbfa-4d50-a40f-4dbf07a179ff req-9f6be3b3-55c4-458d-8f17-c586d042ab20 service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Received unexpected event network-vif-plugged-47696d52-ff5d-4d45-98a7-4eb625245cd6 for instance with vm_state building and task_state spawning.
Nov 13 17:23:58 user nova-compute[75100]: INFO nova.compute.manager [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Took 6.76 seconds to build instance.
Nov 13 17:23:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5848b3d8-6c64-47c6-86a4-53db0a7116d9 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.855s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:23:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:06 user nova-compute[75100]: INFO nova.compute.manager [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Rescuing
Nov 13 17:24:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:24:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquired lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:24:06 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:24:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Updating instance_info_cache with network_info: [{"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Releasing lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-09126e86-80cd-499f-9208-f3fb3575ca59 req-b15f8591-aca1-4380-b8cc-c94af0ab3b41 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-unplugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-09126e86-80cd-499f-9208-f3fb3575ca59 req-b15f8591-aca1-4380-b8cc-c94af0ab3b41 service nova] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-09126e86-80cd-499f-9208-f3fb3575ca59 req-b15f8591-aca1-4380-b8cc-c94af0ab3b41 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-09126e86-80cd-499f-9208-f3fb3575ca59 req-b15f8591-aca1-4380-b8cc-c94af0ab3b41 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-09126e86-80cd-499f-9208-f3fb3575ca59 req-b15f8591-aca1-4380-b8cc-c94af0ab3b41 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] No waiting events found dispatching network-vif-unplugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:24:07 user nova-compute[75100]: WARNING nova.compute.manager [req-09126e86-80cd-499f-9208-f3fb3575ca59 req-b15f8591-aca1-4380-b8cc-c94af0ab3b41 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received unexpected event network-vif-unplugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 for instance with vm_state active and task_state rescuing.
Nov 13 17:24:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Instance destroyed successfully.
Nov 13 17:24:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Attempting rescue
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75100) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 17:24:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Creating image(s)
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "/opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "/opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "/opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'trusted_certs' on Instance uuid 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.rescue {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.rescue" returned: 0 in 0.052s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'migration_context' on Instance uuid 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.objects.base [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<15b3e2ef-4e0b-4ace-bd74-c34d445b60e1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Start _get_guest_xml network_info=[{"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "vif_mac": "fa:16:3e:41:c9:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'resources' on Instance uuid 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.objects.base [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<15b3e2ef-4e0b-4ace-bd74-c34d445b60e1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'numa_topology' on Instance uuid 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:07 user nova-compute[75100]: DEBUG nova.objects.base [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<15b3e2ef-4e0b-4ace-bd74-c34d445b60e1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:24:08 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:24:08 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'vcpu_model' on Instance uuid 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.objects.base [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<15b3e2ef-4e0b-4ace-bd74-c34d445b60e1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1748995308',display_name='tempest-ServerRescueNegativeTestJSON-server-1748995308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1748995308',id=2,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6c1d1cfd844465e85239be73eb73cec',ramdisk_id='',reservation_id='r-xo00uc1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1273984533',owner_user_name='tempest-ServerRescueNegativeTestJSON-1273984533-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:19:42Z,user_data=None,user_id='33657093c7ab4112994a1b7e997cfb34',uuid=15b3e2ef-4e0b-4ace-bd74-c34d445b60e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "vif_mac": "fa:16:3e:41:c9:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converting VIF {"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "vif_mac": "fa:16:3e:41:c9:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:c9:ce,bridge_name='br-int',has_traffic_filtering=True,id=66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66fc9bb6-ce') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'pci_devices' on Instance uuid 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.objects.base [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<15b3e2ef-4e0b-4ace-bd74-c34d445b60e1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:24:08 user nova-compute[75100]:   <uuid>15b3e2ef-4e0b-4ace-bd74-c34d445b60e1</uuid>
Nov 13 17:24:08 user nova-compute[75100]:   <name>instance-00000002</name>
Nov 13 17:24:08 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:24:08 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:24:08 user nova-compute[75100]:   <metadata>
Nov 13 17:24:08 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:24:08 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:24:08 user nova-compute[75100]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1748995308</nova:name>
Nov 13 17:24:08 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:24:08</nova:creationTime>
Nov 13 17:24:08 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:24:08 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:24:08 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:24:08 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:24:08 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:24:08 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:24:08 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:24:08 user nova-compute[75100]:       <nova:owner>
Nov 13 17:24:08 user nova-compute[75100]:         <nova:user uuid="33657093c7ab4112994a1b7e997cfb34">tempest-ServerRescueNegativeTestJSON-1273984533-project-member</nova:user>
Nov 13 17:24:08 user nova-compute[75100]:         <nova:project uuid="d6c1d1cfd844465e85239be73eb73cec">tempest-ServerRescueNegativeTestJSON-1273984533</nova:project>
Nov 13 17:24:08 user nova-compute[75100]:       </nova:owner>
Nov 13 17:24:08 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:24:08 user nova-compute[75100]:       <nova:ports>
Nov 13 17:24:08 user nova-compute[75100]:         <nova:port uuid="66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36">
Nov 13 17:24:08 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 17:24:08 user nova-compute[75100]:         </nova:port>
Nov 13 17:24:08 user nova-compute[75100]:       </nova:ports>
Nov 13 17:24:08 user nova-compute[75100]:     </nova:instance>
Nov 13 17:24:08 user nova-compute[75100]:   </metadata>
Nov 13 17:24:08 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:24:08 user nova-compute[75100]:     <system>
Nov 13 17:24:08 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:24:08 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:24:08 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:24:08 user nova-compute[75100]:       <entry name="serial">15b3e2ef-4e0b-4ace-bd74-c34d445b60e1</entry>
Nov 13 17:24:08 user nova-compute[75100]:       <entry name="uuid">15b3e2ef-4e0b-4ace-bd74-c34d445b60e1</entry>
Nov 13 17:24:08 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:24:08 user nova-compute[75100]:     </system>
Nov 13 17:24:08 user nova-compute[75100]:   </sysinfo>
Nov 13 17:24:08 user nova-compute[75100]:   <os>
Nov 13 17:24:08 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:24:08 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:24:08 user nova-compute[75100]:   </os>
Nov 13 17:24:08 user nova-compute[75100]:   <features>
Nov 13 17:24:08 user nova-compute[75100]:     <acpi/>
Nov 13 17:24:08 user nova-compute[75100]:     <apic/>
Nov 13 17:24:08 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:24:08 user nova-compute[75100]:   </features>
Nov 13 17:24:08 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:24:08 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:24:08 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:24:08 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:24:08 user nova-compute[75100]:   </clock>
Nov 13 17:24:08 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:24:08 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:24:08 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:24:08 user nova-compute[75100]:   </cpu>
Nov 13 17:24:08 user nova-compute[75100]:   <devices>
Nov 13 17:24:08 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:24:08 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:24:08 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.rescue"/>
Nov 13 17:24:08 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:24:08 user nova-compute[75100]:     </disk>
Nov 13 17:24:08 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:24:08 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:24:08 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk"/>
Nov 13 17:24:08 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:24:08 user nova-compute[75100]:     </disk>
Nov 13 17:24:08 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:24:08 user nova-compute[75100]:       <mac address="fa:16:3e:41:c9:ce"/>
Nov 13 17:24:08 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:24:08 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:24:08 user nova-compute[75100]:       <target dev="tap66fc9bb6-ce"/>
Nov 13 17:24:08 user nova-compute[75100]:     </interface>
Nov 13 17:24:08 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:24:08 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/console.log" append="off"/>
Nov 13 17:24:08 user nova-compute[75100]:     </serial>
Nov 13 17:24:08 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:24:08 user nova-compute[75100]:     <video>
Nov 13 17:24:08 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:24:08 user nova-compute[75100]:     </video>
Nov 13 17:24:08 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:24:08 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:24:08 user nova-compute[75100]:     </rng>
Nov 13 17:24:08 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:24:08 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:24:08 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:24:08 user nova-compute[75100]:     </memballoon>
Nov 13 17:24:08 user nova-compute[75100]:   </devices>
Nov 13 17:24:08 user nova-compute[75100]: </domain>
Nov 13 17:24:08 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:24:08 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Instance destroyed successfully.
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No VIF found with MAC fa:16:3e:41:c9:ce, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:24:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-57cc96d4-652d-43f0-b2c2-a29f1aeb2e3e req-1571e5cd-0a8a-4ed6-aee6-a1c2549699d8 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57cc96d4-652d-43f0-b2c2-a29f1aeb2e3e req-1571e5cd-0a8a-4ed6-aee6-a1c2549699d8 service nova] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57cc96d4-652d-43f0-b2c2-a29f1aeb2e3e req-1571e5cd-0a8a-4ed6-aee6-a1c2549699d8 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57cc96d4-652d-43f0-b2c2-a29f1aeb2e3e req-1571e5cd-0a8a-4ed6-aee6-a1c2549699d8 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-57cc96d4-652d-43f0-b2c2-a29f1aeb2e3e req-1571e5cd-0a8a-4ed6-aee6-a1c2549699d8 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] No waiting events found dispatching network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:24:09 user nova-compute[75100]: WARNING nova.compute.manager [req-57cc96d4-652d-43f0-b2c2-a29f1aeb2e3e req-1571e5cd-0a8a-4ed6-aee6-a1c2549699d8 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received unexpected event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 for instance with vm_state active and task_state rescuing.
Nov 13 17:24:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-24b2c04c-220e-479a-982b-0b787cff7c5b req-77ed06f7-29ed-4e94-8713-6321192f0238 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-24b2c04c-220e-479a-982b-0b787cff7c5b req-77ed06f7-29ed-4e94-8713-6321192f0238 service nova] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-24b2c04c-220e-479a-982b-0b787cff7c5b req-77ed06f7-29ed-4e94-8713-6321192f0238 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-24b2c04c-220e-479a-982b-0b787cff7c5b req-77ed06f7-29ed-4e94-8713-6321192f0238 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-24b2c04c-220e-479a-982b-0b787cff7c5b req-77ed06f7-29ed-4e94-8713-6321192f0238 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] No waiting events found dispatching network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:24:11 user nova-compute[75100]: WARNING nova.compute.manager [req-24b2c04c-220e-479a-982b-0b787cff7c5b req-77ed06f7-29ed-4e94-8713-6321192f0238 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received unexpected event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 for instance with vm_state active and task_state rescuing.
Nov 13 17:24:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-24b2c04c-220e-479a-982b-0b787cff7c5b req-77ed06f7-29ed-4e94-8713-6321192f0238 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-24b2c04c-220e-479a-982b-0b787cff7c5b req-77ed06f7-29ed-4e94-8713-6321192f0238 service nova] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-24b2c04c-220e-479a-982b-0b787cff7c5b req-77ed06f7-29ed-4e94-8713-6321192f0238 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-24b2c04c-220e-479a-982b-0b787cff7c5b req-77ed06f7-29ed-4e94-8713-6321192f0238 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-24b2c04c-220e-479a-982b-0b787cff7c5b req-77ed06f7-29ed-4e94-8713-6321192f0238 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] No waiting events found dispatching network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:24:11 user nova-compute[75100]: WARNING nova.compute.manager [req-24b2c04c-220e-479a-982b-0b787cff7c5b req-77ed06f7-29ed-4e94-8713-6321192f0238 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received unexpected event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 for instance with vm_state active and task_state rescuing.
Nov 13 17:24:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4c6a245b-108e-404f-ae1f-a824d0dba84a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:24:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:24:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:16 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:24:16 user nova-compute[75100]: INFO nova.compute.claims [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Claim successful on node user
Nov 13 17:24:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:24:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:24:17 user nova-compute[75100]: DEBUG nova.policy [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15122cbfe21b4775b679285eeb4beff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43327ade8a814488bb141835e2ac331b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:24:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Creating image(s)
Nov 13 17:24:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "/opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "/opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:17 user nova-compute[75100]: INFO nova.compute.manager [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Rescuing
Nov 13 17:24:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquired lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:24:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk 1073741824" returned: 0 in 0.063s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.213s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Successfully created port: 0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Updating instance_info_cache with network_info: [{"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Releasing lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Cannot resize image /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Ensure instance console log exists: /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Successfully updated port: 0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquired lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-0d0ee3fc-6731-48c1-a497-21445eb909a3 req-be611844-dca4-4743-9574-0e1336a03f42 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-changed-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-0d0ee3fc-6731-48c1-a497-21445eb909a3 req-be611844-dca4-4743-9574-0e1336a03f42 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Refreshing instance network info cache due to event network-changed-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0d0ee3fc-6731-48c1-a497-21445eb909a3 req-be611844-dca4-4743-9574-0e1336a03f42 service nova] Acquiring lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:24:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Instance destroyed successfully.
Nov 13 17:24:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Attempting a stable device rescue
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75100) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 17:24:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Creating image(s)
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "/opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "/opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "/opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'trusted_certs' on Instance uuid 83d28254-9d5f-4190-85de-76f5a2b69dac {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-2d5e43b2-3dd0-4f50-9e83-d26e537c21f2 req-fb1ab8cb-141c-4cfc-a994-d006d48eb589 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-unplugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2d5e43b2-3dd0-4f50-9e83-d26e537c21f2 req-fb1ab8cb-141c-4cfc-a994-d006d48eb589 service nova] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2d5e43b2-3dd0-4f50-9e83-d26e537c21f2 req-fb1ab8cb-141c-4cfc-a994-d006d48eb589 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2d5e43b2-3dd0-4f50-9e83-d26e537c21f2 req-fb1ab8cb-141c-4cfc-a994-d006d48eb589 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-2d5e43b2-3dd0-4f50-9e83-d26e537c21f2 req-fb1ab8cb-141c-4cfc-a994-d006d48eb589 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] No waiting events found dispatching network-vif-unplugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:24:19 user nova-compute[75100]: WARNING nova.compute.manager [req-2d5e43b2-3dd0-4f50-9e83-d26e537c21f2 req-fb1ab8cb-141c-4cfc-a994-d006d48eb589 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received unexpected event network-vif-unplugged-d15270b0-a020-4fc1-bac3-3ea3da038478 for instance with vm_state active and task_state rescuing.
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "f0c5bec05ac27637e6af8ce61e4927803a3127b7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "f0c5bec05ac27637e6af8ce61e4927803a3127b7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Updating instance_info_cache with network_info: [{"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Releasing lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance network_info: |[{"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0d0ee3fc-6731-48c1-a497-21445eb909a3 req-be611844-dca4-4743-9574-0e1336a03f42 service nova] Acquired lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-0d0ee3fc-6731-48c1-a497-21445eb909a3 req-be611844-dca4-4743-9574-0e1336a03f42 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Refreshing network info cache for port 0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:24:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Start _get_guest_xml network_info=[{"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:24:20 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:24:20 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-562088828',display_name='tempest-AttachVolumeTestJSON-server-562088828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-562088828',id=18,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0MMK9PR6LTDNy8k+1ome/7/JGCOaYN5Lt3qsENjyVjimlQSRra7KUpWuRZjUfo9P1bMI6EsGXlo4/Ypy8Z5ugzSg6hpliFDTFbfMjRXxyPD7FFbeVCCUZ1dM7RZ0z3bQ==',key_name='tempest-keypair-673460478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43327ade8a814488bb141835e2ac331b',ramdisk_id='',reservation_id='r-4p2x10pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2091682056',owner_user_name='tempest-AttachVolumeTestJSON-2091682056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:24:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15122cbfe21b4775b679285eeb4beff7',uuid=d2c4575b-ef8d-4a9d-9650-459366b7227e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converting VIF {"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'pci_devices' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:24:20 user nova-compute[75100]:   <uuid>d2c4575b-ef8d-4a9d-9650-459366b7227e</uuid>
Nov 13 17:24:20 user nova-compute[75100]:   <name>instance-00000012</name>
Nov 13 17:24:20 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:24:20 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:24:20 user nova-compute[75100]:   <metadata>
Nov 13 17:24:20 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:24:20 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:24:20 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeTestJSON-server-562088828</nova:name>
Nov 13 17:24:20 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:24:20</nova:creationTime>
Nov 13 17:24:20 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:24:20 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:24:20 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:24:20 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:24:20 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:24:20 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:24:20 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:24:20 user nova-compute[75100]:       <nova:owner>
Nov 13 17:24:20 user nova-compute[75100]:         <nova:user uuid="15122cbfe21b4775b679285eeb4beff7">tempest-AttachVolumeTestJSON-2091682056-project-member</nova:user>
Nov 13 17:24:20 user nova-compute[75100]:         <nova:project uuid="43327ade8a814488bb141835e2ac331b">tempest-AttachVolumeTestJSON-2091682056</nova:project>
Nov 13 17:24:20 user nova-compute[75100]:       </nova:owner>
Nov 13 17:24:20 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:24:20 user nova-compute[75100]:       <nova:ports>
Nov 13 17:24:20 user nova-compute[75100]:         <nova:port uuid="0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd">
Nov 13 17:24:20 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 17:24:20 user nova-compute[75100]:         </nova:port>
Nov 13 17:24:20 user nova-compute[75100]:       </nova:ports>
Nov 13 17:24:20 user nova-compute[75100]:     </nova:instance>
Nov 13 17:24:20 user nova-compute[75100]:   </metadata>
Nov 13 17:24:20 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:24:20 user nova-compute[75100]:     <system>
Nov 13 17:24:20 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:24:20 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:24:20 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:24:20 user nova-compute[75100]:       <entry name="serial">d2c4575b-ef8d-4a9d-9650-459366b7227e</entry>
Nov 13 17:24:20 user nova-compute[75100]:       <entry name="uuid">d2c4575b-ef8d-4a9d-9650-459366b7227e</entry>
Nov 13 17:24:20 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:24:20 user nova-compute[75100]:     </system>
Nov 13 17:24:20 user nova-compute[75100]:   </sysinfo>
Nov 13 17:24:20 user nova-compute[75100]:   <os>
Nov 13 17:24:20 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:24:20 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:24:20 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:24:20 user nova-compute[75100]:   </os>
Nov 13 17:24:20 user nova-compute[75100]:   <features>
Nov 13 17:24:20 user nova-compute[75100]:     <acpi/>
Nov 13 17:24:20 user nova-compute[75100]:     <apic/>
Nov 13 17:24:20 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:24:20 user nova-compute[75100]:   </features>
Nov 13 17:24:20 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:24:20 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:24:20 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:24:20 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:24:20 user nova-compute[75100]:   </clock>
Nov 13 17:24:20 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:24:20 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:24:20 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:24:20 user nova-compute[75100]:   </cpu>
Nov 13 17:24:20 user nova-compute[75100]:   <devices>
Nov 13 17:24:20 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:24:20 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:24:20 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk"/>
Nov 13 17:24:20 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:24:20 user nova-compute[75100]:     </disk>
Nov 13 17:24:20 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:24:20 user nova-compute[75100]:       <mac address="fa:16:3e:00:52:b6"/>
Nov 13 17:24:20 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:24:20 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:24:20 user nova-compute[75100]:       <target dev="tap0bb5ab2c-fa"/>
Nov 13 17:24:20 user nova-compute[75100]:     </interface>
Nov 13 17:24:20 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:24:20 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/console.log" append="off"/>
Nov 13 17:24:20 user nova-compute[75100]:     </serial>
Nov 13 17:24:20 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:24:20 user nova-compute[75100]:     <video>
Nov 13 17:24:20 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:24:20 user nova-compute[75100]:     </video>
Nov 13 17:24:20 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:24:20 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:24:20 user nova-compute[75100]:     </rng>
Nov 13 17:24:20 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:24:20 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:24:20 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:24:20 user nova-compute[75100]:     </memballoon>
Nov 13 17:24:20 user nova-compute[75100]:   </devices>
Nov 13 17:24:20 user nova-compute[75100]: </domain>
Nov 13 17:24:20 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-562088828',display_name='tempest-AttachVolumeTestJSON-server-562088828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-562088828',id=18,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0MMK9PR6LTDNy8k+1ome/7/JGCOaYN5Lt3qsENjyVjimlQSRra7KUpWuRZjUfo9P1bMI6EsGXlo4/Ypy8Z5ugzSg6hpliFDTFbfMjRXxyPD7FFbeVCCUZ1dM7RZ0z3bQ==',key_name='tempest-keypair-673460478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43327ade8a814488bb141835e2ac331b',ramdisk_id='',reservation_id='r-4p2x10pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2091682056',owner_user_name='tempest-AttachVolumeTestJSON-2091682056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:24:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15122cbfe21b4775b679285eeb4beff7',uuid=d2c4575b-ef8d-4a9d-9650-459366b7227e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converting VIF {"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG os_vif [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92bcfe63-957a-5dc6-9286-3f885375511d', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bb5ab2c-fa, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bb5ab2c-fa, col_values=(('qos', UUID('1422a10f-1cb0-46ad-acf6-8ea722489e0c')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bb5ab2c-fa, col_values=(('external_ids', {'iface-id': '0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:52:b6', 'vm-uuid': 'd2c4575b-ef8d-4a9d-9650-459366b7227e'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:24:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:20 user nova-compute[75100]: INFO os_vif [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa')
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7.part --force-share --output=json" returned: 0 in 0.251s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG nova.virt.images [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] cdf7ac68-f196-4542-b878-ee20ed1e9cbb was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7.part /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No VIF found with MAC fa:16:3e:00:52:b6, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-0d0ee3fc-6731-48c1-a497-21445eb909a3 req-be611844-dca4-4743-9574-0e1336a03f42 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Updated VIF entry in instance network info cache for port 0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-0d0ee3fc-6731-48c1-a497-21445eb909a3 req-be611844-dca4-4743-9574-0e1336a03f42 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Updating instance_info_cache with network_info: [{"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0d0ee3fc-6731-48c1-a497-21445eb909a3 req-be611844-dca4-4743-9574-0e1336a03f42 service nova] Releasing lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-89d61715-e2a7-4285-908a-7bb280fdb4ab req-3c715674-a132-4325-b4bf-1bcbdaf334ce service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-89d61715-e2a7-4285-908a-7bb280fdb4ab req-3c715674-a132-4325-b4bf-1bcbdaf334ce service nova] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-89d61715-e2a7-4285-908a-7bb280fdb4ab req-3c715674-a132-4325-b4bf-1bcbdaf334ce service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-89d61715-e2a7-4285-908a-7bb280fdb4ab req-3c715674-a132-4325-b4bf-1bcbdaf334ce service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-89d61715-e2a7-4285-908a-7bb280fdb4ab req-3c715674-a132-4325-b4bf-1bcbdaf334ce service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] No waiting events found dispatching network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:24:21 user nova-compute[75100]: WARNING nova.compute.manager [req-89d61715-e2a7-4285-908a-7bb280fdb4ab req-3c715674-a132-4325-b4bf-1bcbdaf334ce service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received unexpected event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 for instance with vm_state active and task_state rescuing.
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7.part /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7.converted" returned: 0 in 0.728s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "f0c5bec05ac27637e6af8ce61e4927803a3127b7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.240s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "f0c5bec05ac27637e6af8ce61e4927803a3127b7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "f0c5bec05ac27637e6af8ce61e4927803a3127b7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7 --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7,backing_fmt=raw /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.rescue {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7,backing_fmt=raw /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.rescue" returned: 0 in 0.053s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "f0c5bec05ac27637e6af8ce61e4927803a3127b7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'migration_context' on Instance uuid 83d28254-9d5f-4190-85de-76f5a2b69dac {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.objects.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Object Instance<83d28254-9d5f-4190-85de-76f5a2b69dac> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Start _get_guest_xml network_info=[{"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "vif_mac": "fa:16:3e:d0:d9:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cdf7ac68-f196-4542-b878-ee20ed1e9cbb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '5df1ce95-5084-4e7f-93d6-f07c0b9959a3', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxgqfret', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '83d28254-9d5f-4190-85de-76f5a2b69dac', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4b547be-9d01-4fe4-86fc-b62242a82ab9', 'serial': 'a4b547be-9d01-4fe4-86fc-b62242a82ab9'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'resources' on Instance uuid 83d28254-9d5f-4190-85de-76f5a2b69dac {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.objects.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Object Instance<83d28254-9d5f-4190-85de-76f5a2b69dac> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'numa_topology' on Instance uuid 83d28254-9d5f-4190-85de-76f5a2b69dac {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.objects.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Object Instance<83d28254-9d5f-4190-85de-76f5a2b69dac> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:24:22 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:24:22 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'vcpu_model' on Instance uuid 83d28254-9d5f-4190-85de-76f5a2b69dac {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.objects.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Object Instance<83d28254-9d5f-4190-85de-76f5a2b69dac> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxgqfret', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:24:22 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:24:22 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:24:22 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02a3066-4fb4-4433-a0b5-48e305fd6812]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = jxgqfret\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 17:24:22 user nova-compute[75100]: node.name = iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:24:22 user nova-compute[75100]: node.tpgt = -1
Nov 13 17:24:22 user nova-compute[75100]: node.startup = automatic
Nov 13 17:24:22 user nova-compute[75100]: node.leading_login = No
Nov 13 17:24:22 user nova-compute[75100]: iface.iscsi_ifacename = default
Nov 13 17:24:22 user nova-compute[75100]: iface.net_ifacename = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.ipaddress = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.prefix_len = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.hwaddress = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.transport_name = tcp
Nov 13 17:24:22 user nova-compute[75100]: iface.initiatorname = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.state = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.vlan_id = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.vlan_priority = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.vlan_state = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.iface_num = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.mtu = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.port = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.bootproto = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.subnet_mask = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.gateway = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.dhcp_alt_client_id = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.dhcp_dns = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.dhcp_learn_iqn = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.dhcp_vendor_id_state = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.dhcp_vendor_id = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.dhcp_slp_da = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.fragmentation = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.gratuitous_arp = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.incoming_forwarding = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.tos_state = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.tos = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.ttl = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.delayed_ack = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.tcp_nagle = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.tcp_wsf_state = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.tcp_wsf = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.tcp_timer_scale = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.tcp_timestamp = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.redirect = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.def_task_mgmt_timeout = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.header_digest = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.data_digest = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.immediate_data = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.initial_r2t = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.data_seq_inorder = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.data_pdu_inorder = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.erl = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.max_receive_data_len = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.first_burst_len = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.max_outstanding_r2t = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.max_burst_len = 0
Nov 13 17:24:22 user nova-compute[75100]: iface.chap_auth = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.bidi_chap = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.strict_login_compliance = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.discovery_auth = <empty>
Nov 13 17:24:22 user nova-compute[75100]: iface.discovery_logout = <empty>
Nov 13 17:24:22 user nova-compute[75100]: node.discovery_address = <empty>
Nov 13 17:24:22 user nova-compute[75100]: node.discovery_port = 0
Nov 13 17:24:22 user nova-compute[75100]: node.discovery_type = static
Nov 13 17:24:22 user nova-compute[75100]: node.session.initial_cmdsn = 0
Nov 13 17:24:22 user nova-compute[75100]: node.session.initial_login_retry_max = 8
Nov 13 17:24:22 user nova-compute[75100]: node.session.xmit_thread_priority = -20
Nov 13 17:24:22 user nova-compute[75100]: node.session.cmds_max = 128
Nov 13 17:24:22 user nova-compute[75100]: node.session.queue_depth = 32
Nov 13 17:24:22 user nova-compute[75100]: node.session.nr_sessions = 1
Nov 13 17:24:22 user nova-compute[75100]: node.session.auth.authmethod = CHAP
Nov 13 17:24:22 user nova-compute[75100]: node.session.auth.username = jxgqfret
Nov 13 17:24:22 user nova-compute[75100]: node.session.auth.password = ***
Nov 13 17:24:22 user nova-compute[75100]: node.session.auth.username_in = <empty>
Nov 13 17:24:22 user nova-compute[75100]: node.session.auth.password_in = <empty>
Nov 13 17:24:22 user nova-compute[75100]: node.session.auth.chap_algs = MD5
Nov 13 17:24:22 user nova-compute[75100]: node.session.timeo.replacement_timeout = 120
Nov 13 17:24:22 user nova-compute[75100]: node.session.err_timeo.abort_timeout = 15
Nov 13 17:24:22 user nova-compute[75100]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 17:24:22 user nova-compute[75100]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 17:24:22 user nova-compute[75100]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 17:24:22 user nova-compute[75100]: node.session.iscsi.FastAbort = Yes
Nov 13 17:24:22 user nova-compute[75100]: node.session.iscsi.InitialR2T = No
Nov 13 17:24:22 user nova-compute[75100]: node.session.iscsi.ImmediateData = Yes
Nov 13 17:24:22 user nova-compute[75100]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 17:24:22 user nova-compute[75100]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 17:24:22 user nova-compute[75100]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 17:24:22 user nova-compute[75100]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 17:24:22 user nova-compute[75100]: node.session.iscsi.MaxConnections = 1
Nov 13 17:24:22 user nova-compute[75100]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 17:24:22 user nova-compute[75100]: node.session.iscsi.ERL = 0
Nov 13 17:24:22 user nova-compute[75100]: node.session.scan = manual
Nov 13 17:24:22 user nova-compute[75100]: node.session.reopen_max = 0
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].address = 172.16.0.220
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].port = 3260
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].startup = manual
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].tcp.window_size = 524288
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].tcp.type_of_service = 0
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].timeo.logout_timeout = 15
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].timeo.login_timeout = 15
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].timeo.auth_timeout = 45
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].iscsi.DataDigest = None
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].iscsi.IFMarker = No
Nov 13 17:24:22 user nova-compute[75100]: node.conn[0].iscsi.OFMarker = No
Nov 13 17:24:22 user nova-compute[75100]: # END RECORD
Nov 13 17:24:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67e3ecd-1a44-4e45-a4dd-3fa218cdf222]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b57353-1f32-4f09-870f-3b9cbe1cf2d8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxgqfret {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxgqfret" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[56be8c3a-51ec-4a2f-b2e5-43fd6feec536]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jxgqfret'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9847bb-c37a-4402-aa2e-82e66396a895]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7722b68-7763-4c64-8195-f7299d8d33aa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:24:22 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:24:22 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:24:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:24:22 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:24:22 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:24:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] HCTL ('34', '0', '0', 0) found on session 15 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e91da68-88c4-43db-804e-a330cd157c8a]: (4, ('0 0 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching for a device in session 15 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxgqfret', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '26465366534376235', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465366534376235', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:22:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2044782487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2044782487',id=13,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:22:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-pohevv18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:22:43Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=83d28254-9d5f-4190-85de-76f5a2b69dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "vif_mac": "fa:16:3e:d0:d9:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "vif_mac": "fa:16:3e:d0:d9:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=d15270b0-a020-4fc1-bac3-3ea3da038478,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15270b0-a0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'pci_devices' on Instance uuid 83d28254-9d5f-4190-85de-76f5a2b69dac {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.objects.base [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Object Instance<83d28254-9d5f-4190-85de-76f5a2b69dac> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:24:22 user nova-compute[75100]:   <uuid>83d28254-9d5f-4190-85de-76f5a2b69dac</uuid>
Nov 13 17:24:22 user nova-compute[75100]:   <name>instance-0000000d</name>
Nov 13 17:24:22 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:24:22 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:24:22 user nova-compute[75100]:   <metadata>
Nov 13 17:24:22 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:24:22 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:24:22 user nova-compute[75100]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2044782487</nova:name>
Nov 13 17:24:22 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:24:22</nova:creationTime>
Nov 13 17:24:22 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:24:22 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:24:22 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:24:22 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:24:22 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:24:22 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:24:22 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:24:22 user nova-compute[75100]:       <nova:owner>
Nov 13 17:24:22 user nova-compute[75100]:         <nova:user uuid="77f5fd132c0e46438884eaffae0beab9">tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member</nova:user>
Nov 13 17:24:22 user nova-compute[75100]:         <nova:project uuid="f1bf7bde4b774e3dac46d41d32496efa">tempest-ServerBootFromVolumeStableRescueTest-1217233624</nova:project>
Nov 13 17:24:22 user nova-compute[75100]:       </nova:owner>
Nov 13 17:24:22 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:24:22 user nova-compute[75100]:       <nova:ports>
Nov 13 17:24:22 user nova-compute[75100]:         <nova:port uuid="d15270b0-a020-4fc1-bac3-3ea3da038478">
Nov 13 17:24:22 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 17:24:22 user nova-compute[75100]:         </nova:port>
Nov 13 17:24:22 user nova-compute[75100]:       </nova:ports>
Nov 13 17:24:22 user nova-compute[75100]:     </nova:instance>
Nov 13 17:24:22 user nova-compute[75100]:   </metadata>
Nov 13 17:24:22 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:24:22 user nova-compute[75100]:     <system>
Nov 13 17:24:22 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:24:22 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:24:22 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:24:22 user nova-compute[75100]:       <entry name="serial">83d28254-9d5f-4190-85de-76f5a2b69dac</entry>
Nov 13 17:24:22 user nova-compute[75100]:       <entry name="uuid">83d28254-9d5f-4190-85de-76f5a2b69dac</entry>
Nov 13 17:24:22 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:24:22 user nova-compute[75100]:     </system>
Nov 13 17:24:22 user nova-compute[75100]:   </sysinfo>
Nov 13 17:24:22 user nova-compute[75100]:   <os>
Nov 13 17:24:22 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:24:22 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:24:22 user nova-compute[75100]:   </os>
Nov 13 17:24:22 user nova-compute[75100]:   <features>
Nov 13 17:24:22 user nova-compute[75100]:     <acpi/>
Nov 13 17:24:22 user nova-compute[75100]:     <apic/>
Nov 13 17:24:22 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:24:22 user nova-compute[75100]:   </features>
Nov 13 17:24:22 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:24:22 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:24:22 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:24:22 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:24:22 user nova-compute[75100]:   </clock>
Nov 13 17:24:22 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:24:22 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:24:22 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:24:22 user nova-compute[75100]:   </cpu>
Nov 13 17:24:22 user nova-compute[75100]:   <devices>
Nov 13 17:24:22 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:24:22 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:24:22 user nova-compute[75100]:       <source dev="/dev/sdc"/>
Nov 13 17:24:22 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:24:22 user nova-compute[75100]:       <serial>a4b547be-9d01-4fe4-86fc-b62242a82ab9</serial>
Nov 13 17:24:22 user nova-compute[75100]:     </disk>
Nov 13 17:24:22 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:24:22 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:24:22 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.rescue"/>
Nov 13 17:24:22 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:24:22 user nova-compute[75100]:       <boot order="1"/>
Nov 13 17:24:22 user nova-compute[75100]:     </disk>
Nov 13 17:24:22 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:24:22 user nova-compute[75100]:       <mac address="fa:16:3e:d0:d9:37"/>
Nov 13 17:24:22 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:24:22 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:24:22 user nova-compute[75100]:       <target dev="tapd15270b0-a0"/>
Nov 13 17:24:22 user nova-compute[75100]:     </interface>
Nov 13 17:24:22 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:24:22 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/console.log" append="off"/>
Nov 13 17:24:22 user nova-compute[75100]:     </serial>
Nov 13 17:24:22 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:24:22 user nova-compute[75100]:     <video>
Nov 13 17:24:22 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:24:22 user nova-compute[75100]:     </video>
Nov 13 17:24:22 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:24:22 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:24:22 user nova-compute[75100]:     </rng>
Nov 13 17:24:22 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:24:22 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:24:22 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:24:22 user nova-compute[75100]:     </memballoon>
Nov 13 17:24:22 user nova-compute[75100]:   </devices>
Nov 13 17:24:22 user nova-compute[75100]: </domain>
Nov 13 17:24:22 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:24:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Instance destroyed successfully.
Nov 13 17:24:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No VIF found with MAC fa:16:3e:d0:d9:37, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-6b197cd4-3a51-4032-99e7-6e329c720bd7 req-5672d5b0-672b-4d89-9968-b8782f88ec5d service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6b197cd4-3a51-4032-99e7-6e329c720bd7 req-5672d5b0-672b-4d89-9968-b8782f88ec5d service nova] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6b197cd4-3a51-4032-99e7-6e329c720bd7 req-5672d5b0-672b-4d89-9968-b8782f88ec5d service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6b197cd4-3a51-4032-99e7-6e329c720bd7 req-5672d5b0-672b-4d89-9968-b8782f88ec5d service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-6b197cd4-3a51-4032-99e7-6e329c720bd7 req-5672d5b0-672b-4d89-9968-b8782f88ec5d service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] No waiting events found dispatching network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:24:22 user nova-compute[75100]: WARNING nova.compute.manager [req-6b197cd4-3a51-4032-99e7-6e329c720bd7 req-5672d5b0-672b-4d89-9968-b8782f88ec5d service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received unexpected event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd for instance with vm_state building and task_state spawning.
Nov 13 17:24:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-3eaa46eb-efa9-426e-b1b2-2c20d779a117 req-ba294af3-7de0-4f0a-aa1b-0032fb45729d service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3eaa46eb-efa9-426e-b1b2-2c20d779a117 req-ba294af3-7de0-4f0a-aa1b-0032fb45729d service nova] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3eaa46eb-efa9-426e-b1b2-2c20d779a117 req-ba294af3-7de0-4f0a-aa1b-0032fb45729d service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3eaa46eb-efa9-426e-b1b2-2c20d779a117 req-ba294af3-7de0-4f0a-aa1b-0032fb45729d service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-3eaa46eb-efa9-426e-b1b2-2c20d779a117 req-ba294af3-7de0-4f0a-aa1b-0032fb45729d service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] No waiting events found dispatching network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:24:24 user nova-compute[75100]: WARNING nova.compute.manager [req-3eaa46eb-efa9-426e-b1b2-2c20d779a117 req-ba294af3-7de0-4f0a-aa1b-0032fb45729d service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received unexpected event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 for instance with vm_state active and task_state rescuing.
Nov 13 17:24:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-3aaaffef-5366-4d1a-808c-11004a8be91d req-1e429b81-8b4d-4d1d-ac5a-49b17dcf7357 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3aaaffef-5366-4d1a-808c-11004a8be91d req-1e429b81-8b4d-4d1d-ac5a-49b17dcf7357 service nova] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3aaaffef-5366-4d1a-808c-11004a8be91d req-1e429b81-8b4d-4d1d-ac5a-49b17dcf7357 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3aaaffef-5366-4d1a-808c-11004a8be91d req-1e429b81-8b4d-4d1d-ac5a-49b17dcf7357 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-3aaaffef-5366-4d1a-808c-11004a8be91d req-1e429b81-8b4d-4d1d-ac5a-49b17dcf7357 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] No waiting events found dispatching network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:24:25 user nova-compute[75100]: WARNING nova.compute.manager [req-3aaaffef-5366-4d1a-808c-11004a8be91d req-1e429b81-8b4d-4d1d-ac5a-49b17dcf7357 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received unexpected event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd for instance with vm_state building and task_state spawning.
Nov 13 17:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:24:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance spawned successfully.
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:26 user nova-compute[75100]: INFO nova.compute.manager [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Took 8.88 seconds to spawn the instance on the hypervisor.
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-b7a946d4-ee77-4bdf-a39a-bf309f8b4c69 req-7dd07f11-d0df-4333-baac-109dfb8b3d43 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b7a946d4-ee77-4bdf-a39a-bf309f8b4c69 req-7dd07f11-d0df-4333-baac-109dfb8b3d43 service nova] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b7a946d4-ee77-4bdf-a39a-bf309f8b4c69 req-7dd07f11-d0df-4333-baac-109dfb8b3d43 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b7a946d4-ee77-4bdf-a39a-bf309f8b4c69 req-7dd07f11-d0df-4333-baac-109dfb8b3d43 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-b7a946d4-ee77-4bdf-a39a-bf309f8b4c69 req-7dd07f11-d0df-4333-baac-109dfb8b3d43 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] No waiting events found dispatching network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:24:26 user nova-compute[75100]: WARNING nova.compute.manager [req-b7a946d4-ee77-4bdf-a39a-bf309f8b4c69 req-7dd07f11-d0df-4333-baac-109dfb8b3d43 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received unexpected event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 for instance with vm_state active and task_state rescuing.
Nov 13 17:24:26 user nova-compute[75100]: INFO nova.compute.manager [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Took 10.23 seconds to build instance.
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7544013-68e0-40a7-8ada-8eef028eeed4 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.378s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b38c104d-196b-441d-80aa-980fa7e22c8e tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:24:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:24:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7430MB free_disk=25.29556655883789GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Applying migration context for instance 64c9f78b-8ce5-4328-9fb0-93715df6135f as it has an incoming, in-progress migration bc3c4381-3f11-4c13-b9ef-868e809b1c3c. Migration status is finished {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 17:24:30 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating resource usage from migration bc3c4381-3f11-4c13-b9ef-868e809b1c3c
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance eec9ecbd-569c-46ec-9e74-3160c9ccd39f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 5933add2-b8bb-448d-a054-d8527e3c49f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Migration bc3c4381-3f11-4c13-b9ef-868e809b1c3c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 64c9f78b-8ce5-4328-9fb0-93715df6135f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance e96eb705-85e2-4cce-a91d-5d319b1b5083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance aefb432b-20b8-4c65-afd1-5ae501b80b43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d2c4575b-ef8d-4a9d-9650-459366b7227e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:24:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:31 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:24:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:24:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:24:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.717s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:24:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:24:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:24:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:24:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:24:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:24:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updating instance_info_cache with network_info: [{"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:24:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:24:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:24:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:24:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:24:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:24:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:43 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:24:43 user nova-compute[75100]: INFO nova.compute.claims [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Claim successful on node user
Nov 13 17:24:44 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:24:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:24:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG nova.policy [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0b1c7977a9484495b30bcbbbf7710eba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1275e18265645a7a2f9be240c26cc36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:24:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Creating image(s)
Nov 13 17:24:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "/opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "/opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk 1073741824" returned: 0 in 0.055s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Successfully created port: a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Cannot resize image /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Ensure instance console log exists: /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Successfully updated port: a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "refresh_cache-d4f158c3-bcd5-4d5b-8c70-04726b17081a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquired lock "refresh_cache-d4f158c3-bcd5-4d5b-8c70-04726b17081a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:24:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-a625bd15-cbbd-4eac-85b6-b14cde65487a req-57105a9a-c177-47a7-90c1-29eec32bf0cd service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Received event network-changed-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-a625bd15-cbbd-4eac-85b6-b14cde65487a req-57105a9a-c177-47a7-90c1-29eec32bf0cd service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Refreshing instance network info cache due to event network-changed-f8cb620c-cdc4-4191-ae25-c29a6eb099b0. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a625bd15-cbbd-4eac-85b6-b14cde65487a req-57105a9a-c177-47a7-90c1-29eec32bf0cd service nova] Acquiring lock "refresh_cache-eec9ecbd-569c-46ec-9e74-3160c9ccd39f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a625bd15-cbbd-4eac-85b6-b14cde65487a req-57105a9a-c177-47a7-90c1-29eec32bf0cd service nova] Acquired lock "refresh_cache-eec9ecbd-569c-46ec-9e74-3160c9ccd39f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-a625bd15-cbbd-4eac-85b6-b14cde65487a req-57105a9a-c177-47a7-90c1-29eec32bf0cd service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Refreshing network info cache for port f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-0a5ca030-13e9-40ec-a213-5afca367a16d req-de8611d2-1307-4e2b-8bc0-4732f78c1326 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Received event network-changed-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-0a5ca030-13e9-40ec-a213-5afca367a16d req-de8611d2-1307-4e2b-8bc0-4732f78c1326 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Refreshing instance network info cache due to event network-changed-a8f33ad4-03cc-4458-b977-d8db6b1aeb30. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0a5ca030-13e9-40ec-a213-5afca367a16d req-de8611d2-1307-4e2b-8bc0-4732f78c1326 service nova] Acquiring lock "refresh_cache-d4f158c3-bcd5-4d5b-8c70-04726b17081a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Updating instance_info_cache with network_info: [{"id": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "address": "fa:16:3e:0b:72:c0", "network": {"id": "09e96b0d-2707-43df-806a-5b8b09f24843", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1641478356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1275e18265645a7a2f9be240c26cc36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f33ad4-03", "ovs_interfaceid": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Releasing lock "refresh_cache-d4f158c3-bcd5-4d5b-8c70-04726b17081a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Instance network_info: |[{"id": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "address": "fa:16:3e:0b:72:c0", "network": {"id": "09e96b0d-2707-43df-806a-5b8b09f24843", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1641478356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1275e18265645a7a2f9be240c26cc36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f33ad4-03", "ovs_interfaceid": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0a5ca030-13e9-40ec-a213-5afca367a16d req-de8611d2-1307-4e2b-8bc0-4732f78c1326 service nova] Acquired lock "refresh_cache-d4f158c3-bcd5-4d5b-8c70-04726b17081a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-0a5ca030-13e9-40ec-a213-5afca367a16d req-de8611d2-1307-4e2b-8bc0-4732f78c1326 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Refreshing network info cache for port a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Start _get_guest_xml network_info=[{"id": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "address": "fa:16:3e:0b:72:c0", "network": {"id": "09e96b0d-2707-43df-806a-5b8b09f24843", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1641478356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1275e18265645a7a2f9be240c26cc36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f33ad4-03", "ovs_interfaceid": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:24:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:24:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1920556531',display_name='tempest-SnapshotDataIntegrityTests-server-1920556531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1920556531',id=19,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImg0P2/gD3p89dx37HUzmjIDR2e+piPOmxufBicTKFAd6AzX4KNnTXKdVl4u8pkQ4n2VnBaYLIGtCRoRhw+xPYxpliG4UDIoA5mcFisn2kLSEU4wtiVRdvVSBjpjn4Mmw==',key_name='tempest-keypair-1224768050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1275e18265645a7a2f9be240c26cc36',ramdisk_id='',reservation_id='r-gdgh64w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1370226818',owner_user_name='tempest-SnapshotDataIntegrityTests-1370226818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:24:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b1c7977a9484495b30bcbbbf7710eba',uuid=d4f158c3-bcd5-4d5b-8c70-04726b17081a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "address": "fa:16:3e:0b:72:c0", "network": {"id": "09e96b0d-2707-43df-806a-5b8b09f24843", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1641478356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1275e18265645a7a2f9be240c26cc36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f33ad4-03", "ovs_interfaceid": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Converting VIF {"id": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "address": "fa:16:3e:0b:72:c0", "network": {"id": "09e96b0d-2707-43df-806a-5b8b09f24843", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1641478356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1275e18265645a7a2f9be240c26cc36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f33ad4-03", "ovs_interfaceid": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:72:c0,bridge_name='br-int',has_traffic_filtering=True,id=a8f33ad4-03cc-4458-b977-d8db6b1aeb30,network=Network(09e96b0d-2707-43df-806a-5b8b09f24843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f33ad4-03') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'pci_devices' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:24:46 user nova-compute[75100]:   <uuid>d4f158c3-bcd5-4d5b-8c70-04726b17081a</uuid>
Nov 13 17:24:46 user nova-compute[75100]:   <name>instance-00000013</name>
Nov 13 17:24:46 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:24:46 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:24:46 user nova-compute[75100]:   <metadata>
Nov 13 17:24:46 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:24:46 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:24:46 user nova-compute[75100]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1920556531</nova:name>
Nov 13 17:24:46 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:24:46</nova:creationTime>
Nov 13 17:24:46 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:24:46 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:24:46 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:24:46 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:24:46 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:24:46 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:24:46 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:24:46 user nova-compute[75100]:       <nova:owner>
Nov 13 17:24:46 user nova-compute[75100]:         <nova:user uuid="0b1c7977a9484495b30bcbbbf7710eba">tempest-SnapshotDataIntegrityTests-1370226818-project-member</nova:user>
Nov 13 17:24:46 user nova-compute[75100]:         <nova:project uuid="f1275e18265645a7a2f9be240c26cc36">tempest-SnapshotDataIntegrityTests-1370226818</nova:project>
Nov 13 17:24:46 user nova-compute[75100]:       </nova:owner>
Nov 13 17:24:46 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:24:46 user nova-compute[75100]:       <nova:ports>
Nov 13 17:24:46 user nova-compute[75100]:         <nova:port uuid="a8f33ad4-03cc-4458-b977-d8db6b1aeb30">
Nov 13 17:24:46 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 17:24:46 user nova-compute[75100]:         </nova:port>
Nov 13 17:24:46 user nova-compute[75100]:       </nova:ports>
Nov 13 17:24:46 user nova-compute[75100]:     </nova:instance>
Nov 13 17:24:46 user nova-compute[75100]:   </metadata>
Nov 13 17:24:46 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:24:46 user nova-compute[75100]:     <system>
Nov 13 17:24:46 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:24:46 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:24:46 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:24:46 user nova-compute[75100]:       <entry name="serial">d4f158c3-bcd5-4d5b-8c70-04726b17081a</entry>
Nov 13 17:24:46 user nova-compute[75100]:       <entry name="uuid">d4f158c3-bcd5-4d5b-8c70-04726b17081a</entry>
Nov 13 17:24:46 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:24:46 user nova-compute[75100]:     </system>
Nov 13 17:24:46 user nova-compute[75100]:   </sysinfo>
Nov 13 17:24:46 user nova-compute[75100]:   <os>
Nov 13 17:24:46 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:24:46 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:24:46 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:24:46 user nova-compute[75100]:   </os>
Nov 13 17:24:46 user nova-compute[75100]:   <features>
Nov 13 17:24:46 user nova-compute[75100]:     <acpi/>
Nov 13 17:24:46 user nova-compute[75100]:     <apic/>
Nov 13 17:24:46 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:24:46 user nova-compute[75100]:   </features>
Nov 13 17:24:46 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:24:46 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:24:46 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:24:46 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:24:46 user nova-compute[75100]:   </clock>
Nov 13 17:24:46 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:24:46 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:24:46 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:24:46 user nova-compute[75100]:   </cpu>
Nov 13 17:24:46 user nova-compute[75100]:   <devices>
Nov 13 17:24:46 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:24:46 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:24:46 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk"/>
Nov 13 17:24:46 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:24:46 user nova-compute[75100]:     </disk>
Nov 13 17:24:46 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:24:46 user nova-compute[75100]:       <mac address="fa:16:3e:0b:72:c0"/>
Nov 13 17:24:46 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:24:46 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:24:46 user nova-compute[75100]:       <target dev="tapa8f33ad4-03"/>
Nov 13 17:24:46 user nova-compute[75100]:     </interface>
Nov 13 17:24:46 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:24:46 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/console.log" append="off"/>
Nov 13 17:24:46 user nova-compute[75100]:     </serial>
Nov 13 17:24:46 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:24:46 user nova-compute[75100]:     <video>
Nov 13 17:24:46 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:24:46 user nova-compute[75100]:     </video>
Nov 13 17:24:46 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:24:46 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:24:46 user nova-compute[75100]:     </rng>
Nov 13 17:24:46 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:24:46 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:24:46 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:24:46 user nova-compute[75100]:     </memballoon>
Nov 13 17:24:46 user nova-compute[75100]:   </devices>
Nov 13 17:24:46 user nova-compute[75100]: </domain>
Nov 13 17:24:46 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1920556531',display_name='tempest-SnapshotDataIntegrityTests-server-1920556531',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1920556531',id=19,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImg0P2/gD3p89dx37HUzmjIDR2e+piPOmxufBicTKFAd6AzX4KNnTXKdVl4u8pkQ4n2VnBaYLIGtCRoRhw+xPYxpliG4UDIoA5mcFisn2kLSEU4wtiVRdvVSBjpjn4Mmw==',key_name='tempest-keypair-1224768050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1275e18265645a7a2f9be240c26cc36',ramdisk_id='',reservation_id='r-gdgh64w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1370226818',owner_user_name='tempest-SnapshotDataIntegrityTests-1370226818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:24:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b1c7977a9484495b30bcbbbf7710eba',uuid=d4f158c3-bcd5-4d5b-8c70-04726b17081a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "address": "fa:16:3e:0b:72:c0", "network": {"id": "09e96b0d-2707-43df-806a-5b8b09f24843", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1641478356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1275e18265645a7a2f9be240c26cc36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f33ad4-03", "ovs_interfaceid": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Converting VIF {"id": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "address": "fa:16:3e:0b:72:c0", "network": {"id": "09e96b0d-2707-43df-806a-5b8b09f24843", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1641478356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1275e18265645a7a2f9be240c26cc36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f33ad4-03", "ovs_interfaceid": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:72:c0,bridge_name='br-int',has_traffic_filtering=True,id=a8f33ad4-03cc-4458-b977-d8db6b1aeb30,network=Network(09e96b0d-2707-43df-806a-5b8b09f24843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f33ad4-03') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG os_vif [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:72:c0,bridge_name='br-int',has_traffic_filtering=True,id=a8f33ad4-03cc-4458-b977-d8db6b1aeb30,network=Network(09e96b0d-2707-43df-806a-5b8b09f24843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f33ad4-03') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9006b0c9-159c-573d-b3d3-2310bbcfc355', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8f33ad4-03, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8f33ad4-03, col_values=(('qos', UUID('7cb4e748-f012-4382-b7f0-ebadd805dcd3')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8f33ad4-03, col_values=(('external_ids', {'iface-id': 'a8f33ad4-03cc-4458-b977-d8db6b1aeb30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:72:c0', 'vm-uuid': 'd4f158c3-bcd5-4d5b-8c70-04726b17081a'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:24:46 user nova-compute[75100]: INFO os_vif [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:72:c0,bridge_name='br-int',has_traffic_filtering=True,id=a8f33ad4-03cc-4458-b977-d8db6b1aeb30,network=Network(09e96b0d-2707-43df-806a-5b8b09f24843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f33ad4-03')
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No VIF found with MAC fa:16:3e:0b:72:c0, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-a625bd15-cbbd-4eac-85b6-b14cde65487a req-57105a9a-c177-47a7-90c1-29eec32bf0cd service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Updated VIF entry in instance network info cache for port f8cb620c-cdc4-4191-ae25-c29a6eb099b0. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-a625bd15-cbbd-4eac-85b6-b14cde65487a req-57105a9a-c177-47a7-90c1-29eec32bf0cd service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Updating instance_info_cache with network_info: [{"id": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "address": "fa:16:3e:9c:81:1e", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb620c-cd", "ovs_interfaceid": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a625bd15-cbbd-4eac-85b6-b14cde65487a req-57105a9a-c177-47a7-90c1-29eec32bf0cd service nova] Releasing lock "refresh_cache-eec9ecbd-569c-46ec-9e74-3160c9ccd39f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-0a5ca030-13e9-40ec-a213-5afca367a16d req-de8611d2-1307-4e2b-8bc0-4732f78c1326 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Updated VIF entry in instance network info cache for port a8f33ad4-03cc-4458-b977-d8db6b1aeb30. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-0a5ca030-13e9-40ec-a213-5afca367a16d req-de8611d2-1307-4e2b-8bc0-4732f78c1326 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Updating instance_info_cache with network_info: [{"id": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "address": "fa:16:3e:0b:72:c0", "network": {"id": "09e96b0d-2707-43df-806a-5b8b09f24843", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1641478356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1275e18265645a7a2f9be240c26cc36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f33ad4-03", "ovs_interfaceid": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0a5ca030-13e9-40ec-a213-5afca367a16d req-de8611d2-1307-4e2b-8bc0-4732f78c1326 service nova] Releasing lock "refresh_cache-d4f158c3-bcd5-4d5b-8c70-04726b17081a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:24:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-9ae0a78f-7284-498b-843a-39367dd6b1d1 req-b19d7905-250b-423b-ac98-990123ca6800 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Received event network-vif-plugged-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9ae0a78f-7284-498b-843a-39367dd6b1d1 req-b19d7905-250b-423b-ac98-990123ca6800 service nova] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9ae0a78f-7284-498b-843a-39367dd6b1d1 req-b19d7905-250b-423b-ac98-990123ca6800 service nova] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9ae0a78f-7284-498b-843a-39367dd6b1d1 req-b19d7905-250b-423b-ac98-990123ca6800 service nova] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-9ae0a78f-7284-498b-843a-39367dd6b1d1 req-b19d7905-250b-423b-ac98-990123ca6800 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] No waiting events found dispatching network-vif-plugged-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:24:48 user nova-compute[75100]: WARNING nova.compute.manager [req-9ae0a78f-7284-498b-843a-39367dd6b1d1 req-b19d7905-250b-423b-ac98-990123ca6800 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Received unexpected event network-vif-plugged-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 for instance with vm_state building and task_state spawning.
Nov 13 17:24:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:24:50 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Instance spawned successfully.
Nov 13 17:24:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-8563c6d5-6bd3-4538-abaa-9b11e36629c5 req-db3ea2f4-5c6e-4211-a967-d56132cffadb service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Received event network-vif-plugged-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8563c6d5-6bd3-4538-abaa-9b11e36629c5 req-db3ea2f4-5c6e-4211-a967-d56132cffadb service nova] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8563c6d5-6bd3-4538-abaa-9b11e36629c5 req-db3ea2f4-5c6e-4211-a967-d56132cffadb service nova] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8563c6d5-6bd3-4538-abaa-9b11e36629c5 req-db3ea2f4-5c6e-4211-a967-d56132cffadb service nova] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-8563c6d5-6bd3-4538-abaa-9b11e36629c5 req-db3ea2f4-5c6e-4211-a967-d56132cffadb service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] No waiting events found dispatching network-vif-plugged-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:24:50 user nova-compute[75100]: WARNING nova.compute.manager [req-8563c6d5-6bd3-4538-abaa-9b11e36629c5 req-db3ea2f4-5c6e-4211-a967-d56132cffadb service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Received unexpected event network-vif-plugged-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 for instance with vm_state building and task_state spawning.
Nov 13 17:24:50 user nova-compute[75100]: INFO nova.compute.manager [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 13 17:24:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:24:50 user nova-compute[75100]: INFO nova.compute.manager [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Took 6.54 seconds to build instance.
Nov 13 17:24:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0907e84c-efd4-418d-b34f-5db136fa3011 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.647s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "872216e9-0900-4427-949e-a6fadef5afc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "872216e9-0900-4427-949e-a6fadef5afc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:24:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:24:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:24:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:24:52 user nova-compute[75100]: INFO nova.compute.claims [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Claim successful on node user
Nov 13 17:24:53 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:24:53 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:24:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:24:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:24:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:24:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:24:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:24:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:24:53 user nova-compute[75100]: INFO nova.virt.block_device [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Booting with volume snapshot 75ed9f5b-b21f-4e36-91af-28dd993c03d4 at /dev/vda
Nov 13 17:24:53 user nova-compute[75100]: DEBUG nova.policy [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '421484d1f180498fa5e078c084d70986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bd8fd1a36f49a08be3d97799e847a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:24:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Successfully created port: 9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:24:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Successfully updated port: 9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:24:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "refresh_cache-872216e9-0900-4427-949e-a6fadef5afc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:24:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquired lock "refresh_cache-872216e9-0900-4427-949e-a6fadef5afc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:24:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:24:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-97521e14-0913-4d93-b06c-676458481105 req-3d8a9ad6-d42f-4a3a-82dc-f84e65a4ba7c service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Received event network-changed-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:24:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-97521e14-0913-4d93-b06c-676458481105 req-3d8a9ad6-d42f-4a3a-82dc-f84e65a4ba7c service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Refreshing instance network info cache due to event network-changed-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:24:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97521e14-0913-4d93-b06c-676458481105 req-3d8a9ad6-d42f-4a3a-82dc-f84e65a4ba7c service nova] Acquiring lock "refresh_cache-872216e9-0900-4427-949e-a6fadef5afc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:24:56 user nova-compute[75100]: DEBUG nova.network.neutron [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:24:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:57 user nova-compute[75100]: DEBUG nova.network.neutron [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Updating instance_info_cache with network_info: [{"id": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "address": "fa:16:3e:59:ae:36", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6743f6-03", "ovs_interfaceid": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:24:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Releasing lock "refresh_cache-872216e9-0900-4427-949e-a6fadef5afc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:24:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Instance network_info: |[{"id": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "address": "fa:16:3e:59:ae:36", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6743f6-03", "ovs_interfaceid": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:24:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97521e14-0913-4d93-b06c-676458481105 req-3d8a9ad6-d42f-4a3a-82dc-f84e65a4ba7c service nova] Acquired lock "refresh_cache-872216e9-0900-4427-949e-a6fadef5afc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:24:57 user nova-compute[75100]: DEBUG nova.network.neutron [req-97521e14-0913-4d93-b06c-676458481105 req-3d8a9ad6-d42f-4a3a-82dc-f84e65a4ba7c service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Refreshing network info cache for port 9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:24:58 user nova-compute[75100]: DEBUG nova.network.neutron [req-97521e14-0913-4d93-b06c-676458481105 req-3d8a9ad6-d42f-4a3a-82dc-f84e65a4ba7c service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Updated VIF entry in instance network info cache for port 9d6743f6-0376-4c4f-8b0a-67fabb52aa0d. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:24:58 user nova-compute[75100]: DEBUG nova.network.neutron [req-97521e14-0913-4d93-b06c-676458481105 req-3d8a9ad6-d42f-4a3a-82dc-f84e65a4ba7c service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Updating instance_info_cache with network_info: [{"id": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "address": "fa:16:3e:59:ae:36", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6743f6-03", "ovs_interfaceid": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:24:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97521e14-0913-4d93-b06c-676458481105 req-3d8a9ad6-d42f-4a3a-82dc-f84e65a4ba7c service nova] Releasing lock "refresh_cache-872216e9-0900-4427-949e-a6fadef5afc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:24:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG os_brick.utils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daa6d83-6ee3-4b6e-9fac-2d3b5e76c8c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[018d8d12-ba9a-4a7d-9841-93e8b8030976]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[da55c856-9545-4352-8ea6-b3d9ec1da93f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a9474f-1601-477e-836b-e68594a9a02e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:24:59 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:24:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[421ec72a-1588-458d-b72a-f33b0c995d2d]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG os_brick.utils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:24:59 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Updating existing volume attachment record: 472ae256-bdaf-4652-ba83-6cc9b5b0a467 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:25:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:25:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:25:01 user nova-compute[75100]: INFO nova.compute.claims [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Claim successful on node user
Nov 13 17:25:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:01 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:25:01 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:25:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:25:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG nova.policy [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd81f3463fe4d81829faabc18c938f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9b168baa5460188724804ab3e0c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:25:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Creating image(s)
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "/opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "/opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "/opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk 1073741824" returned: 0 in 0.062s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Successfully created port: cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:25:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Cannot resize image /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Ensure instance console log exists: /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG nova.network.neutron [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Successfully updated port: cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-34cfc345-187d-49bb-a4a7-586a23a2bb76 req-77868e53-e937-47da-8e4a-685abc9b794d service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Received event network-changed-cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-34cfc345-187d-49bb-a4a7-586a23a2bb76 req-77868e53-e937-47da-8e4a-685abc9b794d service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Refreshing instance network info cache due to event network-changed-cb8dca61-0235-46fe-a218-b79fd647ca06. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34cfc345-187d-49bb-a4a7-586a23a2bb76 req-77868e53-e937-47da-8e4a-685abc9b794d service nova] Acquiring lock "refresh_cache-1377f31d-9021-4cc1-9f36-c363d0a8bfda" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34cfc345-187d-49bb-a4a7-586a23a2bb76 req-77868e53-e937-47da-8e4a-685abc9b794d service nova] Acquired lock "refresh_cache-1377f31d-9021-4cc1-9f36-c363d0a8bfda" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-34cfc345-187d-49bb-a4a7-586a23a2bb76 req-77868e53-e937-47da-8e4a-685abc9b794d service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Refreshing network info cache for port cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "refresh_cache-1377f31d-9021-4cc1-9f36-c363d0a8bfda" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:25:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-34cfc345-187d-49bb-a4a7-586a23a2bb76 req-77868e53-e937-47da-8e4a-685abc9b794d service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.network.neutron [req-34cfc345-187d-49bb-a4a7-586a23a2bb76 req-77868e53-e937-47da-8e4a-685abc9b794d service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34cfc345-187d-49bb-a4a7-586a23a2bb76 req-77868e53-e937-47da-8e4a-685abc9b794d service nova] Releasing lock "refresh_cache-1377f31d-9021-4cc1-9f36-c363d0a8bfda" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquired lock "refresh_cache-1377f31d-9021-4cc1-9f36-c363d0a8bfda" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.network.neutron [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.network.neutron [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:25:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Creating image(s)
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Ensure instance console log exists: /opt/stack/data/nova/instances/872216e9-0900-4427-949e-a6fadef5afc9/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Start _get_guest_xml network_info=[{"id": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "address": "fa:16:3e:59:ae:36", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6743f6-03", "ovs_interfaceid": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-13T17:24:47Z,direct_url=<?>,disk_format='qcow2',id=9bfbd578-75ff-4c97-9d08-0b880a77a706,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-769177023',owner='20bd8fd1a36f49a08be3d97799e847a8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-13T17:24:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '472ae256-bdaf-4652-ba83-6cc9b5b0a467', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwCdoAaU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '872216e9-0900-4427-949e-a6fadef5afc9', 'attached_at': '', 'detached_at': '', 'volume_id': '143672fa-cd42-4ad2-a11d-639043f47af2', 'serial': '143672fa-cd42-4ad2-a11d-639043f47af2'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:25:04 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:25:04 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-13T17:24:47Z,direct_url=<?>,disk_format='qcow2',id=9bfbd578-75ff-4c97-9d08-0b880a77a706,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-769177023',owner='20bd8fd1a36f49a08be3d97799e847a8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-13T17:24:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwCdoAaU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:04 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:04 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:04 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4570450e-a906-4bcf-8fec-87fb8e982a2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:25:04 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3285b39-0d0a-4291-87d6-cb88f434fa12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2] added
Nov 13 17:25:04 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaaba59-f951-49a5-93e6-a3311f68ccfa]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc363dd7-3a97-49be-ae8f-57b8ea916d21]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WwCdoAaU {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WwCdoAaU" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0685523-f7c3-419f-b823-e33f7a679e8f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WwCdoAaU'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ddd871-e713-4a00-9390-7079b127b61f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[82acb314-791b-48aa-a99a-f2cf6225d4e1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.network.neutron [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Updating instance_info_cache with network_info: [{"id": "cb8dca61-0235-46fe-a218-b79fd647ca06", "address": "fa:16:3e:9b:ca:22", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8dca61-02", "ovs_interfaceid": "cb8dca61-0235-46fe-a218-b79fd647ca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abe2898-aed1-47c7-b930-8ae2c71cfe95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2, portal: 172.16.0.220,3260]
Nov 13 17:25:04 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2, portal: 172.16.0.220,3260] successful.
Nov 13 17:25:04 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Releasing lock "refresh_cache-1377f31d-9021-4cc1-9f36-c363d0a8bfda" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Instance network_info: |[{"id": "cb8dca61-0235-46fe-a218-b79fd647ca06", "address": "fa:16:3e:9b:ca:22", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8dca61-02", "ovs_interfaceid": "cb8dca61-0235-46fe-a218-b79fd647ca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Start _get_guest_xml network_info=[{"id": "cb8dca61-0235-46fe-a218-b79fd647ca06", "address": "fa:16:3e:9b:ca:22", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8dca61-02", "ovs_interfaceid": "cb8dca61-0235-46fe-a218-b79fd647ca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:04 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:25:04 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1194e4e1-3422-4c96-ac09-57d5ca867d99]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1171367672',display_name='tempest-VolumesActionsTest-instance-1171367672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1171367672',id=21,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ee9b168baa5460188724804ab3e0c46',ramdisk_id='',reservation_id='r-fnf0gpka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1834502567',owner_user_name='tempest-VolumesActionsTest-1834502567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:25:02Z,user_data=None,user_id='6fd81f3463fe4d81829faabc18c938f8',uuid=1377f31d-9021-4cc1-9f36-c363d0a8bfda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb8dca61-0235-46fe-a218-b79fd647ca06", "address": "fa:16:3e:9b:ca:22", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8dca61-02", "ovs_interfaceid": "cb8dca61-0235-46fe-a218-b79fd647ca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Converting VIF {"id": "cb8dca61-0235-46fe-a218-b79fd647ca06", "address": "fa:16:3e:9b:ca:22", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8dca61-02", "ovs_interfaceid": "cb8dca61-0235-46fe-a218-b79fd647ca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ca:22,bridge_name='br-int',has_traffic_filtering=True,id=cb8dca61-0235-46fe-a218-b79fd647ca06,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8dca61-02') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.objects.instance [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lazy-loading 'pci_devices' on Instance uuid 1377f31d-9021-4cc1-9f36-c363d0a8bfda {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[57020769-6d58-417d-844e-e9f82a446a90]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:04 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:25:04 user nova-compute[75100]:   <uuid>1377f31d-9021-4cc1-9f36-c363d0a8bfda</uuid>
Nov 13 17:25:04 user nova-compute[75100]:   <name>instance-00000015</name>
Nov 13 17:25:04 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:25:04 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:25:04 user nova-compute[75100]:   <metadata>
Nov 13 17:25:04 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:25:04 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:25:04 user nova-compute[75100]:       <nova:name>tempest-VolumesActionsTest-instance-1171367672</nova:name>
Nov 13 17:25:04 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:25:04</nova:creationTime>
Nov 13 17:25:04 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:25:04 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:25:04 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:25:04 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:25:04 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:25:04 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:25:04 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:25:04 user nova-compute[75100]:       <nova:owner>
Nov 13 17:25:04 user nova-compute[75100]:         <nova:user uuid="6fd81f3463fe4d81829faabc18c938f8">tempest-VolumesActionsTest-1834502567-project-member</nova:user>
Nov 13 17:25:04 user nova-compute[75100]:         <nova:project uuid="9ee9b168baa5460188724804ab3e0c46">tempest-VolumesActionsTest-1834502567</nova:project>
Nov 13 17:25:04 user nova-compute[75100]:       </nova:owner>
Nov 13 17:25:04 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:25:04 user nova-compute[75100]:       <nova:ports>
Nov 13 17:25:04 user nova-compute[75100]:         <nova:port uuid="cb8dca61-0235-46fe-a218-b79fd647ca06">
Nov 13 17:25:04 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 17:25:04 user nova-compute[75100]:         </nova:port>
Nov 13 17:25:04 user nova-compute[75100]:       </nova:ports>
Nov 13 17:25:04 user nova-compute[75100]:     </nova:instance>
Nov 13 17:25:04 user nova-compute[75100]:   </metadata>
Nov 13 17:25:04 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:25:04 user nova-compute[75100]:     <system>
Nov 13 17:25:04 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:25:04 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:25:04 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:25:04 user nova-compute[75100]:       <entry name="serial">1377f31d-9021-4cc1-9f36-c363d0a8bfda</entry>
Nov 13 17:25:04 user nova-compute[75100]:       <entry name="uuid">1377f31d-9021-4cc1-9f36-c363d0a8bfda</entry>
Nov 13 17:25:04 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:25:04 user nova-compute[75100]:     </system>
Nov 13 17:25:04 user nova-compute[75100]:   </sysinfo>
Nov 13 17:25:04 user nova-compute[75100]:   <os>
Nov 13 17:25:04 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:25:04 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:25:04 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:25:04 user nova-compute[75100]:   </os>
Nov 13 17:25:04 user nova-compute[75100]:   <features>
Nov 13 17:25:04 user nova-compute[75100]:     <acpi/>
Nov 13 17:25:04 user nova-compute[75100]:     <apic/>
Nov 13 17:25:04 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:25:04 user nova-compute[75100]:   </features>
Nov 13 17:25:04 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:25:04 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:25:04 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:25:04 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:25:04 user nova-compute[75100]:   </clock>
Nov 13 17:25:04 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:25:04 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:25:04 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:25:04 user nova-compute[75100]:   </cpu>
Nov 13 17:25:04 user nova-compute[75100]:   <devices>
Nov 13 17:25:04 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:25:04 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:25:04 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk"/>
Nov 13 17:25:04 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:25:04 user nova-compute[75100]:     </disk>
Nov 13 17:25:04 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:25:04 user nova-compute[75100]:       <mac address="fa:16:3e:9b:ca:22"/>
Nov 13 17:25:04 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:25:04 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:25:04 user nova-compute[75100]:       <target dev="tapcb8dca61-02"/>
Nov 13 17:25:04 user nova-compute[75100]:     </interface>
Nov 13 17:25:04 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:25:04 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/console.log" append="off"/>
Nov 13 17:25:04 user nova-compute[75100]:     </serial>
Nov 13 17:25:04 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:25:04 user nova-compute[75100]:     <video>
Nov 13 17:25:04 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:25:04 user nova-compute[75100]:     </video>
Nov 13 17:25:04 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:25:04 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:25:04 user nova-compute[75100]:     </rng>
Nov 13 17:25:04 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:25:04 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:25:04 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:25:04 user nova-compute[75100]:     </memballoon>
Nov 13 17:25:04 user nova-compute[75100]:   </devices>
Nov 13 17:25:04 user nova-compute[75100]: </domain>
Nov 13 17:25:04 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1171367672',display_name='tempest-VolumesActionsTest-instance-1171367672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1171367672',id=21,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ee9b168baa5460188724804ab3e0c46',ramdisk_id='',reservation_id='r-fnf0gpka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1834502567',owner_user_name='tempest-VolumesActionsTest-1834502567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:25:02Z,user_data=None,user_id='6fd81f3463fe4d81829faabc18c938f8',uuid=1377f31d-9021-4cc1-9f36-c363d0a8bfda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb8dca61-0235-46fe-a218-b79fd647ca06", "address": "fa:16:3e:9b:ca:22", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8dca61-02", "ovs_interfaceid": "cb8dca61-0235-46fe-a218-b79fd647ca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Converting VIF {"id": "cb8dca61-0235-46fe-a218-b79fd647ca06", "address": "fa:16:3e:9b:ca:22", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8dca61-02", "ovs_interfaceid": "cb8dca61-0235-46fe-a218-b79fd647ca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ca:22,bridge_name='br-int',has_traffic_filtering=True,id=cb8dca61-0235-46fe-a218-b79fd647ca06,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8dca61-02') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_vif [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ca:22,bridge_name='br-int',has_traffic_filtering=True,id=cb8dca61-0235-46fe-a218-b79fd647ca06,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8dca61-02') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ca9dd46-b6db-5166-974d-970b45b389c4', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef5b805-be80-4b21-8814-3eb4738df87e]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwCdoAaU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb8dca61-02, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb8dca61-02, col_values=(('qos', UUID('272eae87-c556-4461-acef-77244ba50de2')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb8dca61-02, col_values=(('external_ids', {'iface-id': 'cb8dca61-0235-46fe-a218-b79fd647ca06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:ca:22', 'vm-uuid': '1377f31d-9021-4cc1-9f36-c363d0a8bfda'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:04 user nova-compute[75100]: INFO os_vif [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ca:22,bridge_name='br-int',has_traffic_filtering=True,id=cb8dca61-0235-46fe-a218-b79fd647ca06,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8dca61-02')
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:25:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] No VIF found with MAC fa:16:3e:9b:ca:22, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23336373134383263', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336373134383263', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1906344795',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1906344795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1906344795',id=20,image_ref='9bfbd578-75ff-4c97-9d08-0b880a77a706',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALvZK6tNuys7myWuCpwz2LU+V+k90+nXGe2eF7f4BMLxTQhE1OCCr/FuyNUNbg6+W0quwQhhIntnH6yyUorddRY/ALF7V2MIUG8YthZANsWT1QhVOcq/EfBNBrj1jv2SA==',key_name='tempest-keypair-711334570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-eyyesxfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1156978750',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='421484d1f180498fa5e078c084d70986',uuid=872216e9-0900-4427-949e-a6fadef5afc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "address": "fa:16:3e:59:ae:36", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6743f6-03", "ovs_interfaceid": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "address": "fa:16:3e:59:ae:36", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6743f6-03", "ovs_interfaceid": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ae:36,bridge_name='br-int',has_traffic_filtering=True,id=9d6743f6-0376-4c4f-8b0a-67fabb52aa0d,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6743f6-03') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.objects.instance [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lazy-loading 'pci_devices' on Instance uuid 872216e9-0900-4427-949e-a6fadef5afc9 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:25:05 user nova-compute[75100]:   <uuid>872216e9-0900-4427-949e-a6fadef5afc9</uuid>
Nov 13 17:25:05 user nova-compute[75100]:   <name>instance-00000014</name>
Nov 13 17:25:05 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:25:05 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:25:05 user nova-compute[75100]:   <metadata>
Nov 13 17:25:05 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:25:05 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:25:05 user nova-compute[75100]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1906344795</nova:name>
Nov 13 17:25:05 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:25:04</nova:creationTime>
Nov 13 17:25:05 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:25:05 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:25:05 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:25:05 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:25:05 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:25:05 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:25:05 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:25:05 user nova-compute[75100]:       <nova:owner>
Nov 13 17:25:05 user nova-compute[75100]:         <nova:user uuid="421484d1f180498fa5e078c084d70986">tempest-TestVolumeBootPattern-1156978750-project-member</nova:user>
Nov 13 17:25:05 user nova-compute[75100]:         <nova:project uuid="20bd8fd1a36f49a08be3d97799e847a8">tempest-TestVolumeBootPattern-1156978750</nova:project>
Nov 13 17:25:05 user nova-compute[75100]:       </nova:owner>
Nov 13 17:25:05 user nova-compute[75100]:       <nova:root type="image" uuid="9bfbd578-75ff-4c97-9d08-0b880a77a706"/>
Nov 13 17:25:05 user nova-compute[75100]:       <nova:ports>
Nov 13 17:25:05 user nova-compute[75100]:         <nova:port uuid="9d6743f6-0376-4c4f-8b0a-67fabb52aa0d">
Nov 13 17:25:05 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 17:25:05 user nova-compute[75100]:         </nova:port>
Nov 13 17:25:05 user nova-compute[75100]:       </nova:ports>
Nov 13 17:25:05 user nova-compute[75100]:     </nova:instance>
Nov 13 17:25:05 user nova-compute[75100]:   </metadata>
Nov 13 17:25:05 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:25:05 user nova-compute[75100]:     <system>
Nov 13 17:25:05 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:25:05 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:25:05 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:25:05 user nova-compute[75100]:       <entry name="serial">872216e9-0900-4427-949e-a6fadef5afc9</entry>
Nov 13 17:25:05 user nova-compute[75100]:       <entry name="uuid">872216e9-0900-4427-949e-a6fadef5afc9</entry>
Nov 13 17:25:05 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:25:05 user nova-compute[75100]:     </system>
Nov 13 17:25:05 user nova-compute[75100]:   </sysinfo>
Nov 13 17:25:05 user nova-compute[75100]:   <os>
Nov 13 17:25:05 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:25:05 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:25:05 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:25:05 user nova-compute[75100]:   </os>
Nov 13 17:25:05 user nova-compute[75100]:   <features>
Nov 13 17:25:05 user nova-compute[75100]:     <acpi/>
Nov 13 17:25:05 user nova-compute[75100]:     <apic/>
Nov 13 17:25:05 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:25:05 user nova-compute[75100]:   </features>
Nov 13 17:25:05 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:25:05 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:25:05 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:25:05 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:25:05 user nova-compute[75100]:   </clock>
Nov 13 17:25:05 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:25:05 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:25:05 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:25:05 user nova-compute[75100]:   </cpu>
Nov 13 17:25:05 user nova-compute[75100]:   <devices>
Nov 13 17:25:05 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:25:05 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:25:05 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 13 17:25:05 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:25:05 user nova-compute[75100]:       <serial>143672fa-cd42-4ad2-a11d-639043f47af2</serial>
Nov 13 17:25:05 user nova-compute[75100]:     </disk>
Nov 13 17:25:05 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:25:05 user nova-compute[75100]:       <mac address="fa:16:3e:59:ae:36"/>
Nov 13 17:25:05 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:25:05 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:25:05 user nova-compute[75100]:       <target dev="tap9d6743f6-03"/>
Nov 13 17:25:05 user nova-compute[75100]:     </interface>
Nov 13 17:25:05 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:25:05 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/872216e9-0900-4427-949e-a6fadef5afc9/console.log" append="off"/>
Nov 13 17:25:05 user nova-compute[75100]:     </serial>
Nov 13 17:25:05 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:25:05 user nova-compute[75100]:     <video>
Nov 13 17:25:05 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:25:05 user nova-compute[75100]:     </video>
Nov 13 17:25:05 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:25:05 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:25:05 user nova-compute[75100]:     </rng>
Nov 13 17:25:05 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:25:05 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:25:05 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:25:05 user nova-compute[75100]:     </memballoon>
Nov 13 17:25:05 user nova-compute[75100]:   </devices>
Nov 13 17:25:05 user nova-compute[75100]: </domain>
Nov 13 17:25:05 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1906344795',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1906344795',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1906344795',id=20,image_ref='9bfbd578-75ff-4c97-9d08-0b880a77a706',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALvZK6tNuys7myWuCpwz2LU+V+k90+nXGe2eF7f4BMLxTQhE1OCCr/FuyNUNbg6+W0quwQhhIntnH6yyUorddRY/ALF7V2MIUG8YthZANsWT1QhVOcq/EfBNBrj1jv2SA==',key_name='tempest-keypair-711334570',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-eyyesxfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1156978750',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='421484d1f180498fa5e078c084d70986',uuid=872216e9-0900-4427-949e-a6fadef5afc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "address": "fa:16:3e:59:ae:36", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6743f6-03", "ovs_interfaceid": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "address": "fa:16:3e:59:ae:36", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6743f6-03", "ovs_interfaceid": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:ae:36,bridge_name='br-int',has_traffic_filtering=True,id=9d6743f6-0376-4c4f-8b0a-67fabb52aa0d,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6743f6-03') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG os_vif [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ae:36,bridge_name='br-int',has_traffic_filtering=True,id=9d6743f6-0376-4c4f-8b0a-67fabb52aa0d,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6743f6-03') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2cb1341-bf3b-5003-9213-92b8b0ce68a6', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d6743f6-03, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d6743f6-03, col_values=(('qos', UUID('32b20769-090a-4723-85ce-f8c8d2ea7363')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d6743f6-03, col_values=(('external_ids', {'iface-id': '9d6743f6-0376-4c4f-8b0a-67fabb52aa0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:ae:36', 'vm-uuid': '872216e9-0900-4427-949e-a6fadef5afc9'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:05 user nova-compute[75100]: INFO os_vif [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:ae:36,bridge_name='br-int',has_traffic_filtering=True,id=9d6743f6-0376-4c4f-8b0a-67fabb52aa0d,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6743f6-03')
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] No VIF found with MAC fa:16:3e:59:ae:36, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-74ef92b3-57bb-4045-a3be-93fd2d4baafa req-fced5ee3-a2bb-41ca-99ec-851ccc524abd service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received event network-changed-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-74ef92b3-57bb-4045-a3be-93fd2d4baafa req-fced5ee3-a2bb-41ca-99ec-851ccc524abd service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Refreshing instance network info cache due to event network-changed-f3f52df4-25c5-4c98-9a0c-76093617c180. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74ef92b3-57bb-4045-a3be-93fd2d4baafa req-fced5ee3-a2bb-41ca-99ec-851ccc524abd service nova] Acquiring lock "refresh_cache-5933add2-b8bb-448d-a054-d8527e3c49f8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74ef92b3-57bb-4045-a3be-93fd2d4baafa req-fced5ee3-a2bb-41ca-99ec-851ccc524abd service nova] Acquired lock "refresh_cache-5933add2-b8bb-448d-a054-d8527e3c49f8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:25:05 user nova-compute[75100]: DEBUG nova.network.neutron [req-74ef92b3-57bb-4045-a3be-93fd2d4baafa req-fced5ee3-a2bb-41ca-99ec-851ccc524abd service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Refreshing network info cache for port f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG nova.network.neutron [req-74ef92b3-57bb-4045-a3be-93fd2d4baafa req-fced5ee3-a2bb-41ca-99ec-851ccc524abd service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Updated VIF entry in instance network info cache for port f3f52df4-25c5-4c98-9a0c-76093617c180. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG nova.network.neutron [req-74ef92b3-57bb-4045-a3be-93fd2d4baafa req-fced5ee3-a2bb-41ca-99ec-851ccc524abd service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Updating instance_info_cache with network_info: [{"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74ef92b3-57bb-4045-a3be-93fd2d4baafa req-fced5ee3-a2bb-41ca-99ec-851ccc524abd service nova] Releasing lock "refresh_cache-5933add2-b8bb-448d-a054-d8527e3c49f8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG nova.objects.instance [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lazy-loading 'flavor' on Instance uuid 5933add2-b8bb-448d-a054-d8527e3c49f8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:06 user nova-compute[75100]: INFO nova.compute.manager [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Attaching volume a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e to /dev/vdb
Nov 13 17:25:06 user nova-compute[75100]: DEBUG os_brick.utils [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[454d3d59-6b81-4212-9e0f-04586763a133]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c633202b-8508-4509-9022-1b4bca8c4884]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49aebaf-dd82-48f1-aec6-b4277e513ce7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a3ac24-eb11-40ac-a28f-08db9178b5dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:25:06 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bb8245-be51-49b4-ab62-5118564754d9]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG os_brick.utils [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Updating existing volume attachment record: f829cc57-785e-429c-884e-6a4865f44245 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-31328a6a-b1d9-4c5c-b783-0431cabfdc45 req-21622f73-22ea-4667-be47-94b054ae1cac service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Received event network-vif-plugged-cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-31328a6a-b1d9-4c5c-b783-0431cabfdc45 req-21622f73-22ea-4667-be47-94b054ae1cac service nova] Acquiring lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-31328a6a-b1d9-4c5c-b783-0431cabfdc45 req-21622f73-22ea-4667-be47-94b054ae1cac service nova] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-31328a6a-b1d9-4c5c-b783-0431cabfdc45 req-21622f73-22ea-4667-be47-94b054ae1cac service nova] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-31328a6a-b1d9-4c5c-b783-0431cabfdc45 req-21622f73-22ea-4667-be47-94b054ae1cac service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] No waiting events found dispatching network-vif-plugged-cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:06 user nova-compute[75100]: WARNING nova.compute.manager [req-31328a6a-b1d9-4c5c-b783-0431cabfdc45 req-21622f73-22ea-4667-be47-94b054ae1cac service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Received unexpected event network-vif-plugged-cb8dca61-0235-46fe-a218-b79fd647ca06 for instance with vm_state building and task_state spawning.
Nov 13 17:25:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-7eab96f9-5188-4fdb-953c-82e321ba4c0c req-befdfbd4-7ca8-4380-8957-ee1a3c1b5b3c service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Received event network-vif-plugged-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7eab96f9-5188-4fdb-953c-82e321ba4c0c req-befdfbd4-7ca8-4380-8957-ee1a3c1b5b3c service nova] Acquiring lock "872216e9-0900-4427-949e-a6fadef5afc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7eab96f9-5188-4fdb-953c-82e321ba4c0c req-befdfbd4-7ca8-4380-8957-ee1a3c1b5b3c service nova] Lock "872216e9-0900-4427-949e-a6fadef5afc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7eab96f9-5188-4fdb-953c-82e321ba4c0c req-befdfbd4-7ca8-4380-8957-ee1a3c1b5b3c service nova] Lock "872216e9-0900-4427-949e-a6fadef5afc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-7eab96f9-5188-4fdb-953c-82e321ba4c0c req-befdfbd4-7ca8-4380-8957-ee1a3c1b5b3c service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] No waiting events found dispatching network-vif-plugged-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:07 user nova-compute[75100]: WARNING nova.compute.manager [req-7eab96f9-5188-4fdb-953c-82e321ba4c0c req-befdfbd4-7ca8-4380-8957-ee1a3c1b5b3c service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Received unexpected event network-vif-plugged-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d for instance with vm_state building and task_state spawning.
Nov 13 17:25:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-ed72b009-fc0a-48ba-8aae-49cbe0bda61b req-4b953645-9eeb-4de1-aeed-9ab71ee7eecb service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Received event network-vif-plugged-cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ed72b009-fc0a-48ba-8aae-49cbe0bda61b req-4b953645-9eeb-4de1-aeed-9ab71ee7eecb service nova] Acquiring lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ed72b009-fc0a-48ba-8aae-49cbe0bda61b req-4b953645-9eeb-4de1-aeed-9ab71ee7eecb service nova] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ed72b009-fc0a-48ba-8aae-49cbe0bda61b req-4b953645-9eeb-4de1-aeed-9ab71ee7eecb service nova] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-ed72b009-fc0a-48ba-8aae-49cbe0bda61b req-4b953645-9eeb-4de1-aeed-9ab71ee7eecb service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] No waiting events found dispatching network-vif-plugged-cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:08 user nova-compute[75100]: WARNING nova.compute.manager [req-ed72b009-fc0a-48ba-8aae-49cbe0bda61b req-4b953645-9eeb-4de1-aeed-9ab71ee7eecb service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Received unexpected event network-vif-plugged-cb8dca61-0235-46fe-a218-b79fd647ca06 for instance with vm_state building and task_state spawning.
Nov 13 17:25:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:25:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:25:09 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Instance spawned successfully.
Nov 13 17:25:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:25:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:10 user nova-compute[75100]: INFO nova.compute.manager [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-ae732f3b-efe7-4bdf-8eac-c8eac8140ce5 req-4140deef-b804-4548-9291-0b69ab989710 service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Received event network-vif-plugged-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ae732f3b-efe7-4bdf-8eac-c8eac8140ce5 req-4140deef-b804-4548-9291-0b69ab989710 service nova] Acquiring lock "872216e9-0900-4427-949e-a6fadef5afc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ae732f3b-efe7-4bdf-8eac-c8eac8140ce5 req-4140deef-b804-4548-9291-0b69ab989710 service nova] Lock "872216e9-0900-4427-949e-a6fadef5afc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ae732f3b-efe7-4bdf-8eac-c8eac8140ce5 req-4140deef-b804-4548-9291-0b69ab989710 service nova] Lock "872216e9-0900-4427-949e-a6fadef5afc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-ae732f3b-efe7-4bdf-8eac-c8eac8140ce5 req-4140deef-b804-4548-9291-0b69ab989710 service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] No waiting events found dispatching network-vif-plugged-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:10 user nova-compute[75100]: WARNING nova.compute.manager [req-ae732f3b-efe7-4bdf-8eac-c8eac8140ce5 req-4140deef-b804-4548-9291-0b69ab989710 service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Received unexpected event network-vif-plugged-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d for instance with vm_state building and task_state spawning.
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:25:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Instance spawned successfully.
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:25:10 user nova-compute[75100]: INFO nova.compute.manager [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Took 17.16 seconds to build instance.
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74a26c4a-b161-4c2a-9f2a-ba49176ac17d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "872216e9-0900-4427-949e-a6fadef5afc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.281s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:10 user nova-compute[75100]: INFO nova.compute.manager [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Took 7.94 seconds to spawn the instance on the hypervisor.
Nov 13 17:25:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:25:10 user nova-compute[75100]: INFO nova.compute.manager [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Took 8.83 seconds to build instance.
Nov 13 17:25:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-55cfbe9a-1998-4728-a571-a59a9928e2ab tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.931s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlRENGhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:11 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:11 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:11 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e3961b-04d7-4d41-a53d-258dbd1e4922]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:25:11 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d671d51-1671-4b21-83fd-c2e6eb7b3069]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e] added
Nov 13 17:25:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13c533f-1c96-4b8e-8306-1a58d5f9de7b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd05ccdb-ee7f-4841-bc7e-410d00b33a9d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SlRENGhL {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SlRENGhL" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0067aba-8405-480d-9968-d1573b8ea78a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SlRENGhL'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed8b818-dd52-40a9-ab68-10ad7eda2431]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[269a0e2c-7ba3-43b9-bafb-8dedb2c8293b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[226f745c-5204-4546-b054-036c3f53c709]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260]
Nov 13 17:25:11 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260] successful.
Nov 13 17:25:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5a8cc8-e936-4c0e-b5d9-e1256b7c6b6f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8545582c-5ec9-4986-af58-d99ee5b217e7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:11 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:11 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] HCTL ('37', '-', '-', 0) found on session 20 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99902bc-0b6a-459b-b4d9-81e1b3e5c42f]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching for a device in session 20 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:25:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlRENGhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:25:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23462616239306566', 'path': '/dev/sdf'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462616239306566', 'path': '/dev/sdf'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:25:12 user nova-compute[75100]: DEBUG nova.objects.instance [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lazy-loading 'flavor' on Instance uuid 5933add2-b8bb-448d-a054-d8527e3c49f8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:25:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:25:12 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:25:12 user nova-compute[75100]:   <source dev="/dev/sdf"/>
Nov 13 17:25:12 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:25:12 user nova-compute[75100]:   <serial>a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e</serial>
Nov 13 17:25:12 user nova-compute[75100]: </disk>
Nov 13 17:25:12 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:25:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:25:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:25:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No VIF found with MAC fa:16:3e:d4:ef:78, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:25:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fc80a328-290f-4527-9e2b-ea8b7bee1224 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.499s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:13 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Port 4d8ea93b-b607-4f22-ad01-9577465b5997 binding to destination host user is already ACTIVE {{(pid=75100) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 17:25:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:25:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquired lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:25:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:25:15 user nova-compute[75100]: INFO nova.compute.manager [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Rebuilding instance
Nov 13 17:25:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating instance_info_cache with network_info: [{"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Releasing lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Creating tmpfile /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/tmpo51v22up to verify with other compute node that the instance is on the same shared storage. {{(pid=75100) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-c96c0ce4-c95f-460a-87f1-d670b784b9cc req-997256d0-1383-4ed5-90f4-6f544f54ffbb service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-unplugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c96c0ce4-c95f-460a-87f1-d670b784b9cc req-997256d0-1383-4ed5-90f4-6f544f54ffbb service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c96c0ce4-c95f-460a-87f1-d670b784b9cc req-997256d0-1383-4ed5-90f4-6f544f54ffbb service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c96c0ce4-c95f-460a-87f1-d670b784b9cc req-997256d0-1383-4ed5-90f4-6f544f54ffbb service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-c96c0ce4-c95f-460a-87f1-d670b784b9cc req-997256d0-1383-4ed5-90f4-6f544f54ffbb service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-unplugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:15 user nova-compute[75100]: WARNING nova.compute.manager [req-c96c0ce4-c95f-460a-87f1-d670b784b9cc req-997256d0-1383-4ed5-90f4-6f544f54ffbb service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-unplugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state resized and task_state resize_reverting.
Nov 13 17:25:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-b572f06a-bfc8-4464-b997-14e2f984637b req-77358adc-86ed-4583-a83b-7dc2f918a694 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received event network-vif-unplugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b572f06a-bfc8-4464-b997-14e2f984637b req-77358adc-86ed-4583-a83b-7dc2f918a694 service nova] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b572f06a-bfc8-4464-b997-14e2f984637b req-77358adc-86ed-4583-a83b-7dc2f918a694 service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b572f06a-bfc8-4464-b997-14e2f984637b req-77358adc-86ed-4583-a83b-7dc2f918a694 service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-b572f06a-bfc8-4464-b997-14e2f984637b req-77358adc-86ed-4583-a83b-7dc2f918a694 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] No waiting events found dispatching network-vif-unplugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:15 user nova-compute[75100]: WARNING nova.compute.manager [req-b572f06a-bfc8-4464-b997-14e2f984637b req-77358adc-86ed-4583-a83b-7dc2f918a694 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received unexpected event network-vif-unplugged-f3f52df4-25c5-4c98-9a0c-76093617c180 for instance with vm_state active and task_state rebuilding.
Nov 13 17:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Instance destroyed successfully.
Nov 13 17:25:16 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lazy-loading 'resources' on Instance uuid 64c9f78b-8ce5-4328-9fb0-93715df6135f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:25:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Instance destroyed successfully.
Nov 13 17:25:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1879098934',display_name='tempest-ServerActionsTestOtherB-server-1879098934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1879098934',id=6,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtAAW3TgTxHf+TUITy0Mmc2phtGIX31UWPLC6Ax00Ra3rvR7rorviHUXMJmTRs8r7vW2IjeukFIO8Ah6Z/JWvZwng0Wq3UlZJ7OxB5Mha2gh4q+d5taNiDQoe9oXIHuA==',key_name='tempest-keypair-2067438742',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fa1230bfae049af9ce657d6889eddad',ramdisk_id='',reservation_id='r-78tnxuif',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1067719084',owner_user_name='tempest-ServerActionsTestOtherB-1067719084-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='047fae6bc2134ea2a43fb06dbeabbb0b',uuid=64c9f78b-8ce5-4328-9fb0-93715df6135f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converting VIF {"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_vif [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d8ea93b-b6, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f8e6381-389d-447e-842d-4ac4d1b3f114) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:16 user nova-compute[75100]: INFO os_vif [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6')
Nov 13 17:25:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEVWivnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:16 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d876dbcd-0e54-49ea-b653-cd43e8915f0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:25:16 user nova-compute[75100]: No targets found.
Nov 13 17:25:16 user nova-compute[75100]: iSNS:
Nov 13 17:25:16 user nova-compute[75100]: No targets found.
Nov 13 17:25:16 user nova-compute[75100]: STATIC:
Nov 13 17:25:16 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4
Nov 13 17:25:16 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:16 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:16 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:25:16 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:16 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:16 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6
Nov 13 17:25:16 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:16 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:16 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2
Nov 13 17:25:16 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:16 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:16 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e
Nov 13 17:25:16 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:16 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:16 user nova-compute[75100]: FIRMWARE:
Nov 13 17:25:16 user nova-compute[75100]: No targets found.
Nov 13 17:25:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:25:16 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:25:16 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26a3185-521f-4d98-a7cb-414cee99abca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:16 user nova-compute[75100]: INFO nova.compute.manager [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Detaching volume a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac229bc-8335-423b-98c5-2f8225e977d1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:16 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:16 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:16 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:16 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:16 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:16 user nova-compute[75100]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:16 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:16 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c4c24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.105s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6996319f-9518-4608-83f3-f7fef8fdd559]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:16 user nova-compute[75100]: INFO nova.virt.block_device [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Attempting to driver detach volume a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e from mountpoint /dev/vdb
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc4c8a6-5e3b-4151-954c-7ca2e248c277]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Attempting to detach device vdb from instance 5933add2-b8bb-448d-a054-d8527e3c49f8 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:25:16 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:25:16 user nova-compute[75100]:   <source dev="/dev/sdf"/>
Nov 13 17:25:16 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:25:16 user nova-compute[75100]:   <serial>a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e</serial>
Nov 13 17:25:16 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:25:16 user nova-compute[75100]: </disk>
Nov 13 17:25:16 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[daca71f3-d6b9-4c86-a36a-64eb62c3569e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully detached device vdb from instance 5933add2-b8bb-448d-a054-d8527e3c49f8 from the persistent domain config.
Nov 13 17:25:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlRENGhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:16 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1dc279c-de4a-4b2c-89b0-13ea8027a0bf]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bc2a80-2fe9-45a1-8599-b1db92bf0cd7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf818455-9aea-4c61-a505-03aeb80a2adc]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260]
Nov 13 17:25:16 user nova-compute[75100]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260] successful.
Nov 13 17:25:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a80002-960b-4490-a305-9d789a005567]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.484s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] <== disconnect_volume: return (485ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.135s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b30b21-2990-478d-a83c-c33ae719593c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:25:16 user nova-compute[75100]: No targets found.
Nov 13 17:25:16 user nova-compute[75100]: iSNS:
Nov 13 17:25:16 user nova-compute[75100]: No targets found.
Nov 13 17:25:16 user nova-compute[75100]: STATIC:
Nov 13 17:25:16 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:25:16 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:16 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:16 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6
Nov 13 17:25:16 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:16 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:16 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2
Nov 13 17:25:16 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:16 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:16 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e
Nov 13 17:25:16 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:16 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:16 user nova-compute[75100]: FIRMWARE:
Nov 13 17:25:16 user nova-compute[75100]: No targets found.
Nov 13 17:25:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:25:16 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:25:16 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:25:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[41adfa1b-ff55-493e-ab3a-8e8f4d25b647]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef90c9ec-4ae2-4f22-a0c9-c1f8af2ace31]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:17 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:17 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:17 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:17 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:17 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:17 user nova-compute[75100]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c4c3400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e'): ({'sdf'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Removing single pathed devices sdf {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[105d8c99-36d9-4720-9e99-694e929c5a70]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d763688-e555-45ef-b4c7-38196f6f3263]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flushing IO for device /dev/sdf {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aba4ab2-ec9d-409f-8ea2-3a7dcccf4c36]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d689c1-a99f-48ca-b7e2-3c7163fca3ac]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cc45ce-b797-4c67-9fdf-ec54b7a5902f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace43d29-5f4c-4106-ab9b-3396f804110f]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260]
Nov 13 17:25:17 user nova-compute[75100]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260] successful.
Nov 13 17:25:17 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d2bbe0-b3c0-48e3-b354-5a55f8811388]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== disconnect_volume: return (483ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:17 user nova-compute[75100]: WARNING nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state resized and task_state resize_reverting.
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:17 user nova-compute[75100]: WARNING nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state resized and task_state resize_reverting.
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:17 user nova-compute[75100]: WARNING nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state resized and task_state resize_reverting.
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-unplugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-unplugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:17 user nova-compute[75100]: WARNING nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-unplugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state resized and task_state resize_reverting.
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:17 user nova-compute[75100]: WARNING nova.compute.manager [req-74b96dc0-497b-45da-8946-12b2fef9f6dc req-986a870f-2186-4af2-b8b5-1510d6753241 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state resized and task_state resize_reverting.
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-c2182943-462d-4845-9c3c-d055d5445930 req-746f31f3-d515-4be9-80e9-b2aa9883c929 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received event network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c2182943-462d-4845-9c3c-d055d5445930 req-746f31f3-d515-4be9-80e9-b2aa9883c929 service nova] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c2182943-462d-4845-9c3c-d055d5445930 req-746f31f3-d515-4be9-80e9-b2aa9883c929 service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c2182943-462d-4845-9c3c-d055d5445930 req-746f31f3-d515-4be9-80e9-b2aa9883c929 service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-c2182943-462d-4845-9c3c-d055d5445930 req-746f31f3-d515-4be9-80e9-b2aa9883c929 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] No waiting events found dispatching network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:17 user nova-compute[75100]: WARNING nova.compute.manager [req-c2182943-462d-4845-9c3c-d055d5445930 req-746f31f3-d515-4be9-80e9-b2aa9883c929 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received unexpected event network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 for instance with vm_state active and task_state rebuilding.
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:17 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lazy-loading 'migration_context' on Instance uuid 64c9f78b-8ce5-4328-9fb0-93715df6135f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG nova.objects.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Object Instance<64c9f78b-8ce5-4328-9fb0-93715df6135f> lazy-loaded attributes: resources,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:25:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Instance destroyed successfully.
Nov 13 17:25:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:23:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-33132177',display_name='tempest-ServerActionsTestOtherA-server-1631903817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-33132177',id=15,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbFY5LgKRXl7mG8F4M+9+fbhr2HSsopYQvyoxkqIHaLSDggJc3195H3FH3yXGej6QMVhX0ugpcyjD2elnXP0l/zvIcBGJ/8nBKUf7xPxcXKw5IKnnG2QtFINn4u/nqf7w==',key_name='tempest-keypair-558257575',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:23:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-8y9r17uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:25:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=5933add2-b8bb-448d-a054-d8527e3c49f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_vif [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3f52df4-25, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6554e373-e26a-49ef-bbdb-ebbd3378e70c) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:25:18 user nova-compute[75100]: INFO os_vif [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25')
Nov 13 17:25:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlRENGhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:18 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[095bafff-f5fe-49da-ab82-1e2d1207e95f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:25:18 user nova-compute[75100]: No targets found.
Nov 13 17:25:18 user nova-compute[75100]: iSNS:
Nov 13 17:25:18 user nova-compute[75100]: No targets found.
Nov 13 17:25:18 user nova-compute[75100]: STATIC:
Nov 13 17:25:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:25:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:18 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6
Nov 13 17:25:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:18 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2
Nov 13 17:25:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:18 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:18 user nova-compute[75100]: FIRMWARE:
Nov 13 17:25:18 user nova-compute[75100]: No targets found.
Nov 13 17:25:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:25:18 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:25:18 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7079c826-b7f5-4556-9e8e-076359b870c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[591e068a-6ff1-4ed1-9c3e-44f78df17a10]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:18 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:18 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:18 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:18 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38da3010>, {}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Disconnecting from: [] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== disconnect_volume: return (80ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:25:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Deleting instance files /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8_del
Nov 13 17:25:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Deletion of /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8_del complete
Nov 13 17:25:18 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:25:18 user nova-compute[75100]: INFO nova.virt.block_device [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Booting with volume a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e at /dev/vdb
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.612s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.utils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2ac09c-20c0-4b49-a2f4-812574cb1c72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af501370-8f4e-45a0-a82a-95f125b453ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[df54aa86-5105-4597-9d30-1565c0676c00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aceb5d3-89cf-4c3f-b275-a245f1141a02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:25:18 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:25:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf37c55-e25a-40f2-8405-730e1ff76414]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG os_brick.utils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:18 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Updating existing volume attachment record: f106f068-3274-4094-b079-8b23af093a28 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:25:18 user nova-compute[75100]: INFO nova.compute.manager [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Swapping old allocation on dict_keys(['d0cd9ee7-47c1-40a1-b685-446f6384b590']) held by migration bc3c4381-3f11-4c13-b9ef-868e809b1c3c for instance
Nov 13 17:25:18 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Overwriting current allocation {'allocations': {'d0cd9ee7-47c1-40a1-b685-446f6384b590': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': '1fa1230bfae049af9ce657d6889eddad', 'user_id': '047fae6bc2134ea2a43fb06dbeabbb0b', 'consumer_generation': 1} on consumer 64c9f78b-8ce5-4328-9fb0-93715df6135f {{(pid=75100) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquired lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating instance_info_cache with network_info: [{"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Releasing lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG os_brick.utils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f45b4d-a359-483e-9892-aad8b69039e7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb54066-71b2-4c21-b444-2fbade2a742d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb89524-aec6-40d3-a2bc-d684f66081a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2dfebc-f0bf-448f-842e-a34a5fea55dc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:25:19 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:25:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[38522dde-6903-49d7-80e9-67b5ea30c56f]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:25:19 user nova-compute[75100]: DEBUG os_brick.utils [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:25:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 17:25:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating instance_info_cache with network_info: [{"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-64c9f78b-8ce5-4328-9fb0-93715df6135f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:21 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:25:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.653s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:25:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Creating image(s)
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "/opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "/opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "/opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:25:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.230s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk 1073741824" returned: 0 in 0.085s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Starting finish_revert_migration {{(pid=75100) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Start _get_guest_xml network_info=[{"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'dd32f356-9217-4065-a89c-be8517206007', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEVWivnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '64c9f78b-8ce5-4328-9fb0-93715df6135f', 'attached_at': '2023-11-13T17:25:24.000000', 'detached_at': '', 'volume_id': '5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'serial': '5bb32c0e-ed04-4dc9-b83c-805371205ba4'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:25:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:25:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lazy-loading 'vcpu_model' on Instance uuid 64c9f78b-8ce5-4328-9fb0-93715df6135f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEVWivnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:24 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:24 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:24 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[889a8641-b407-4834-bd2e-244e0f650780]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:25:24 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.210s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a952cd7c-1bdd-49ce-a04d-3cf4c9a7cc9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4] added
Nov 13 17:25:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ab67ee-87b2-4474-900c-8a9c70c9f00d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b11d3b-971a-4fc0-930b-00c67d0db168]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEVWivnO {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEVWivnO" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55ff79d-e41a-4a2c-942b-90687020e9fb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yEVWivnO'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Cannot resize image /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Ensure instance console log exists: /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Start _get_guest_xml network_info=[{"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'f106f068-3274-4094-b079-8b23af093a28', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlRENGhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5933add2-b8bb-448d-a054-d8527e3c49f8', 'attached_at': '', 'detached_at': '', 'volume_id': 'a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e', 'serial': 'a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9feccf-bab9-4804-b44c-50c06b78bc1a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 17:25:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5933add2-b8bb-448d-a054-d8527e3c49f8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dfaa51-e566-4e1e-bc3a-d389eddcee75]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlRENGhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:24 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fd52f0-35e6-4fa2-9231-a232a778fc9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260]
Nov 13 17:25:24 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260] successful.
Nov 13 17:25:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aebc4a0-682d-49a3-9462-c8263e03e0e5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbc1735-1d7d-4cce-b35f-7921337f0487]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb49b95-1efa-4540-b6d4-eff8f63a8b1b]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEVWivnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '23230646434323839', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230646434323839', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.159s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:25 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 17:25:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:25 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9712e13-1fad-4612-931d-d21e79c05dfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:25:25 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1879098934',display_name='tempest-ServerActionsTestOtherB-server-1879098934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1879098934',id=6,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtAAW3TgTxHf+TUITy0Mmc2phtGIX31UWPLC6Ax00Ra3rvR7rorviHUXMJmTRs8r7vW2IjeukFIO8Ah6Z/JWvZwng0Wq3UlZJ7OxB5Mha2gh4q+d5taNiDQoe9oXIHuA==',key_name='tempest-keypair-2067438742',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1fa1230bfae049af9ce657d6889eddad',ramdisk_id='',reservation_id='r-78tnxuif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1067719084',owner_user_name='tempest-ServerActionsTestOtherB-1067719084-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='047fae6bc2134ea2a43fb06dbeabbb0b',uuid=64c9f78b-8ce5-4328-9fb0-93715df6135f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converting VIF {"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:25:25 user nova-compute[75100]:   <uuid>64c9f78b-8ce5-4328-9fb0-93715df6135f</uuid>
Nov 13 17:25:25 user nova-compute[75100]:   <name>instance-00000006</name>
Nov 13 17:25:25 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:25:25 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:25:25 user nova-compute[75100]:   <metadata>
Nov 13 17:25:25 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:25:25 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:25:25 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherB-server-1879098934</nova:name>
Nov 13 17:25:25 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:25:24</nova:creationTime>
Nov 13 17:25:25 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:25:25 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:25:25 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:25:25 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:25:25 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:25:25 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:25:25 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:25:25 user nova-compute[75100]:       <nova:owner>
Nov 13 17:25:25 user nova-compute[75100]:         <nova:user uuid="047fae6bc2134ea2a43fb06dbeabbb0b">tempest-ServerActionsTestOtherB-1067719084-project-member</nova:user>
Nov 13 17:25:25 user nova-compute[75100]:         <nova:project uuid="1fa1230bfae049af9ce657d6889eddad">tempest-ServerActionsTestOtherB-1067719084</nova:project>
Nov 13 17:25:25 user nova-compute[75100]:       </nova:owner>
Nov 13 17:25:25 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:25:25 user nova-compute[75100]:       <nova:ports>
Nov 13 17:25:25 user nova-compute[75100]:         <nova:port uuid="4d8ea93b-b607-4f22-ad01-9577465b5997">
Nov 13 17:25:25 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:25:25 user nova-compute[75100]:         </nova:port>
Nov 13 17:25:25 user nova-compute[75100]:       </nova:ports>
Nov 13 17:25:25 user nova-compute[75100]:     </nova:instance>
Nov 13 17:25:25 user nova-compute[75100]:   </metadata>
Nov 13 17:25:25 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:25:25 user nova-compute[75100]:     <system>
Nov 13 17:25:25 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:25:25 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:25:25 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:25:25 user nova-compute[75100]:       <entry name="serial">64c9f78b-8ce5-4328-9fb0-93715df6135f</entry>
Nov 13 17:25:25 user nova-compute[75100]:       <entry name="uuid">64c9f78b-8ce5-4328-9fb0-93715df6135f</entry>
Nov 13 17:25:25 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:25:25 user nova-compute[75100]:     </system>
Nov 13 17:25:25 user nova-compute[75100]:   </sysinfo>
Nov 13 17:25:25 user nova-compute[75100]:   <os>
Nov 13 17:25:25 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:25:25 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:25:25 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:25:25 user nova-compute[75100]:   </os>
Nov 13 17:25:25 user nova-compute[75100]:   <features>
Nov 13 17:25:25 user nova-compute[75100]:     <acpi/>
Nov 13 17:25:25 user nova-compute[75100]:     <apic/>
Nov 13 17:25:25 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:25:25 user nova-compute[75100]:   </features>
Nov 13 17:25:25 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:25:25 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:25:25 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:25:25 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:25:25 user nova-compute[75100]:   </clock>
Nov 13 17:25:25 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:25:25 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:25:25 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:25:25 user nova-compute[75100]:   </cpu>
Nov 13 17:25:25 user nova-compute[75100]:   <devices>
Nov 13 17:25:25 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:25:25 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:25:25 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk"/>
Nov 13 17:25:25 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:25:25 user nova-compute[75100]:     </disk>
Nov 13 17:25:25 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:25:25 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:25:25 user nova-compute[75100]:       <source dev="/dev/sde"/>
Nov 13 17:25:25 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:25:25 user nova-compute[75100]:       <serial>5bb32c0e-ed04-4dc9-b83c-805371205ba4</serial>
Nov 13 17:25:25 user nova-compute[75100]:     </disk>
Nov 13 17:25:25 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:25:25 user nova-compute[75100]:       <mac address="fa:16:3e:f0:3f:b9"/>
Nov 13 17:25:25 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:25:25 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:25:25 user nova-compute[75100]:       <target dev="tap4d8ea93b-b6"/>
Nov 13 17:25:25 user nova-compute[75100]:     </interface>
Nov 13 17:25:25 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:25:25 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/console.log" append="off"/>
Nov 13 17:25:25 user nova-compute[75100]:     </serial>
Nov 13 17:25:25 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:25:25 user nova-compute[75100]:     <video>
Nov 13 17:25:25 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:25:25 user nova-compute[75100]:     </video>
Nov 13 17:25:25 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:25:25 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:25:25 user nova-compute[75100]:     </rng>
Nov 13 17:25:25 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:25:25 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:25:25 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:25:25 user nova-compute[75100]:     </memballoon>
Nov 13 17:25:25 user nova-compute[75100]:   </devices>
Nov 13 17:25:25 user nova-compute[75100]: </domain>
Nov 13 17:25:25 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1879098934',display_name='tempest-ServerActionsTestOtherB-server-1879098934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1879098934',id=6,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtAAW3TgTxHf+TUITy0Mmc2phtGIX31UWPLC6Ax00Ra3rvR7rorviHUXMJmTRs8r7vW2IjeukFIO8Ah6Z/JWvZwng0Wq3UlZJ7OxB5Mha2gh4q+d5taNiDQoe9oXIHuA==',key_name='tempest-keypair-2067438742',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1fa1230bfae049af9ce657d6889eddad',ramdisk_id='',reservation_id='r-78tnxuif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1067719084',owner_user_name='tempest-ServerActionsTestOtherB-1067719084-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='047fae6bc2134ea2a43fb06dbeabbb0b',uuid=64c9f78b-8ce5-4328-9fb0-93715df6135f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converting VIF {"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG os_vif [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4d4ad3-2dd7-4a14-92d0-2049d7c8f1ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e] added
Nov 13 17:25:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48e89590-f317-5f0c-a697-dcd434c33537', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d8ea93b-b6, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d8ea93b-b6, col_values=(('qos', UUID('3db5ea5b-7e3c-4079-ae9a-66e4f70bc041')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d8ea93b-b6, col_values=(('external_ids', {'iface-id': '4d8ea93b-b607-4f22-ad01-9577465b5997', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:3f:b9', 'vm-uuid': '64c9f78b-8ce5-4328-9fb0-93715df6135f'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35e6e8e-e488-49a8-a845-58710bcb4d38]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:25 user nova-compute[75100]: INFO os_vif [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6')
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[51968334-c3f1-4b47-8a45-8564e2c55302]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SlRENGhL {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SlRENGhL" returned: 0 in 0.073s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[60068ea9-0109-4eb4-b498-58b20bb26c27]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SlRENGhL'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3020a8-3064-4d6a-be21-92678369c39d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0578186a-f9cc-436f-9d20-4ca35e9347dd]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2fd5c5-3cb4-4cf5-a502-b25c93584b96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260]
Nov 13 17:25:26 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260] successful.
Nov 13 17:25:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d94adad-87c6-462d-b225-b7267b1a508c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cacf14e-0b16-446c-bfc8-9ac641100fee]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:26 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[555b3d8d-7d54-49f3-a807-55fe8e003324]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlRENGhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-392d9c1e-a52d-43d0-80f3-ecd88f1b9fd7 req-1725b82e-ef35-48d5-825e-e9568768de9a service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Received event network-changed-311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-392d9c1e-a52d-43d0-80f3-ecd88f1b9fd7 req-1725b82e-ef35-48d5-825e-e9568768de9a service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Refreshing instance network info cache due to event network-changed-311b11cf-67e8-42ac-9166-8b24a7fb5238. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-392d9c1e-a52d-43d0-80f3-ecd88f1b9fd7 req-1725b82e-ef35-48d5-825e-e9568768de9a service nova] Acquiring lock "refresh_cache-e96eb705-85e2-4cce-a91d-5d319b1b5083" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-392d9c1e-a52d-43d0-80f3-ecd88f1b9fd7 req-1725b82e-ef35-48d5-825e-e9568768de9a service nova] Acquired lock "refresh_cache-e96eb705-85e2-4cce-a91d-5d319b1b5083" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG nova.network.neutron [req-392d9c1e-a52d-43d0-80f3-ecd88f1b9fd7 req-1725b82e-ef35-48d5-825e-e9568768de9a service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Refreshing network info cache for port 311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:25:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== connect_volume: return (2619ms) {'type': 'block', 'scsi_wwn': '23462616239306566', 'path': '/dev/sdf'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462616239306566', 'path': '/dev/sdf'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:23:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-33132177',display_name='tempest-ServerActionsTestOtherA-server-1631903817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-33132177',id=15,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbFY5LgKRXl7mG8F4M+9+fbhr2HSsopYQvyoxkqIHaLSDggJc3195H3FH3yXGej6QMVhX0ugpcyjD2elnXP0l/zvIcBGJ/8nBKUf7xPxcXKw5IKnnG2QtFINn4u/nqf7w==',key_name='tempest-keypair-558257575',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:23:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-8y9r17uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:25:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=5933add2-b8bb-448d-a054-d8527e3c49f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:25:27 user nova-compute[75100]:   <uuid>5933add2-b8bb-448d-a054-d8527e3c49f8</uuid>
Nov 13 17:25:27 user nova-compute[75100]:   <name>instance-0000000f</name>
Nov 13 17:25:27 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:25:27 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:25:27 user nova-compute[75100]:   <metadata>
Nov 13 17:25:27 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:25:27 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:25:27 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherA-server-1631903817</nova:name>
Nov 13 17:25:27 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:25:24</nova:creationTime>
Nov 13 17:25:27 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:25:27 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:25:27 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:25:27 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:25:27 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:25:27 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:25:27 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:25:27 user nova-compute[75100]:       <nova:owner>
Nov 13 17:25:27 user nova-compute[75100]:         <nova:user uuid="7ea28cc48696459f96e7ad8dacad33da">tempest-ServerActionsTestOtherA-226710821-project-member</nova:user>
Nov 13 17:25:27 user nova-compute[75100]:         <nova:project uuid="119dde6420324f52a165a5610c77d1c3">tempest-ServerActionsTestOtherA-226710821</nova:project>
Nov 13 17:25:27 user nova-compute[75100]:       </nova:owner>
Nov 13 17:25:27 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:25:27 user nova-compute[75100]:       <nova:ports>
Nov 13 17:25:27 user nova-compute[75100]:         <nova:port uuid="f3f52df4-25c5-4c98-9a0c-76093617c180">
Nov 13 17:25:27 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 17:25:27 user nova-compute[75100]:         </nova:port>
Nov 13 17:25:27 user nova-compute[75100]:       </nova:ports>
Nov 13 17:25:27 user nova-compute[75100]:     </nova:instance>
Nov 13 17:25:27 user nova-compute[75100]:   </metadata>
Nov 13 17:25:27 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:25:27 user nova-compute[75100]:     <system>
Nov 13 17:25:27 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:25:27 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:25:27 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:25:27 user nova-compute[75100]:       <entry name="serial">5933add2-b8bb-448d-a054-d8527e3c49f8</entry>
Nov 13 17:25:27 user nova-compute[75100]:       <entry name="uuid">5933add2-b8bb-448d-a054-d8527e3c49f8</entry>
Nov 13 17:25:27 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:25:27 user nova-compute[75100]:     </system>
Nov 13 17:25:27 user nova-compute[75100]:   </sysinfo>
Nov 13 17:25:27 user nova-compute[75100]:   <os>
Nov 13 17:25:27 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:25:27 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:25:27 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:25:27 user nova-compute[75100]:   </os>
Nov 13 17:25:27 user nova-compute[75100]:   <features>
Nov 13 17:25:27 user nova-compute[75100]:     <acpi/>
Nov 13 17:25:27 user nova-compute[75100]:     <apic/>
Nov 13 17:25:27 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:25:27 user nova-compute[75100]:   </features>
Nov 13 17:25:27 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:25:27 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:25:27 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:25:27 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:25:27 user nova-compute[75100]:   </clock>
Nov 13 17:25:27 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:25:27 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:25:27 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:25:27 user nova-compute[75100]:   </cpu>
Nov 13 17:25:27 user nova-compute[75100]:   <devices>
Nov 13 17:25:27 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:25:27 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:25:27 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk"/>
Nov 13 17:25:27 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:25:27 user nova-compute[75100]:     </disk>
Nov 13 17:25:27 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:25:27 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:25:27 user nova-compute[75100]:       <source dev="/dev/sdf"/>
Nov 13 17:25:27 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:25:27 user nova-compute[75100]:       <serial>a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e</serial>
Nov 13 17:25:27 user nova-compute[75100]:     </disk>
Nov 13 17:25:27 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:25:27 user nova-compute[75100]:       <mac address="fa:16:3e:d4:ef:78"/>
Nov 13 17:25:27 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:25:27 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:25:27 user nova-compute[75100]:       <target dev="tapf3f52df4-25"/>
Nov 13 17:25:27 user nova-compute[75100]:     </interface>
Nov 13 17:25:27 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:25:27 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/console.log" append="off"/>
Nov 13 17:25:27 user nova-compute[75100]:     </serial>
Nov 13 17:25:27 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:25:27 user nova-compute[75100]:     <video>
Nov 13 17:25:27 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:25:27 user nova-compute[75100]:     </video>
Nov 13 17:25:27 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:25:27 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:25:27 user nova-compute[75100]:     </rng>
Nov 13 17:25:27 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:25:27 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:25:27 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:25:27 user nova-compute[75100]:     </memballoon>
Nov 13 17:25:27 user nova-compute[75100]:   </devices>
Nov 13 17:25:27 user nova-compute[75100]: </domain>
Nov 13 17:25:27 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:23:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-33132177',display_name='tempest-ServerActionsTestOtherA-server-1631903817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-33132177',id=15,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbFY5LgKRXl7mG8F4M+9+fbhr2HSsopYQvyoxkqIHaLSDggJc3195H3FH3yXGej6QMVhX0ugpcyjD2elnXP0l/zvIcBGJ/8nBKUf7xPxcXKw5IKnnG2QtFINn4u/nqf7w==',key_name='tempest-keypair-558257575',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:23:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-8y9r17uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:25:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=5933add2-b8bb-448d-a054-d8527e3c49f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG os_vif [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9886d19f-f13e-5964-afd1-3a522e21e0cf', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG nova.network.neutron [req-392d9c1e-a52d-43d0-80f3-ecd88f1b9fd7 req-1725b82e-ef35-48d5-825e-e9568768de9a service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Updated VIF entry in instance network info cache for port 311b11cf-67e8-42ac-9166-8b24a7fb5238. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:25:27 user nova-compute[75100]: DEBUG nova.network.neutron [req-392d9c1e-a52d-43d0-80f3-ecd88f1b9fd7 req-1725b82e-ef35-48d5-825e-e9568768de9a service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Updating instance_info_cache with network_info: [{"id": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "address": "fa:16:3e:d0:59:f9", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap311b11cf-67", "ovs_interfaceid": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-b12aa3d1-5f28-4724-9833-8c7bf0297bad req-940db743-cd60-4419-b820-fb0a877c64ab service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b12aa3d1-5f28-4724-9833-8c7bf0297bad req-940db743-cd60-4419-b820-fb0a877c64ab service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b12aa3d1-5f28-4724-9833-8c7bf0297bad req-940db743-cd60-4419-b820-fb0a877c64ab service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b12aa3d1-5f28-4724-9833-8c7bf0297bad req-940db743-cd60-4419-b820-fb0a877c64ab service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-b12aa3d1-5f28-4724-9833-8c7bf0297bad req-940db743-cd60-4419-b820-fb0a877c64ab service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:29 user nova-compute[75100]: WARNING nova.compute.manager [req-b12aa3d1-5f28-4724-9833-8c7bf0297bad req-940db743-cd60-4419-b820-fb0a877c64ab service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state resized and task_state resize_reverting.
Nov 13 17:25:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-392d9c1e-a52d-43d0-80f3-ecd88f1b9fd7 req-1725b82e-ef35-48d5-825e-e9568768de9a service nova] Releasing lock "refresh_cache-e96eb705-85e2-4cce-a91d-5d319b1b5083" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3f52df4-25, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3f52df4-25, col_values=(('qos', UUID('413dfae8-5aa3-4edb-9c07-6dceb6beee08')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3f52df4-25, col_values=(('external_ids', {'iface-id': 'f3f52df4-25c5-4c98-9a0c-76093617c180', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:ef:78', 'vm-uuid': '5933add2-b8bb-448d-a054-d8527e3c49f8'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-2828c813-36a5-4e8f-813d-81ee91963077 req-b14d69c3-2dc8-4f8c-8428-ecaf8cc77726 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2828c813-36a5-4e8f-813d-81ee91963077 req-b14d69c3-2dc8-4f8c-8428-ecaf8cc77726 service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2828c813-36a5-4e8f-813d-81ee91963077 req-b14d69c3-2dc8-4f8c-8428-ecaf8cc77726 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2828c813-36a5-4e8f-813d-81ee91963077 req-b14d69c3-2dc8-4f8c-8428-ecaf8cc77726 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-2828c813-36a5-4e8f-813d-81ee91963077 req-b14d69c3-2dc8-4f8c-8428-ecaf8cc77726 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:29 user nova-compute[75100]: WARNING nova.compute.manager [req-2828c813-36a5-4e8f-813d-81ee91963077 req-b14d69c3-2dc8-4f8c-8428-ecaf8cc77726 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state resized and task_state resize_reverting.
Nov 13 17:25:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lazy-loading 'flavor' on Instance uuid e96eb705-85e2-4cce-a91d-5d319b1b5083 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:25:29 user nova-compute[75100]: INFO os_vif [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25')
Nov 13 17:25:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Instance running successfully.
Nov 13 17:25:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] finish_revert_migration finished successfully. {{(pid=75100) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 13 17:25:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:25:29 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:25:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7095MB free_disk=25.25234603881836GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No VIF found with MAC fa:16:3e:d4:ef:78, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:25:30 user nova-compute[75100]: INFO nova.compute.manager [None req-0e37efcd-0ce6-4c24-8316-492c13c54250 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating instance to original state: 'active'
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:30 user nova-compute[75100]: INFO nova.compute.manager [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Attaching volume 4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d to /dev/vdb
Nov 13 17:25:30 user nova-compute[75100]: DEBUG os_brick.utils [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc9cf37-c9d0-41a8-950b-6db3adde004e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[492bc323-61c9-4728-ae4e-d9281ccad2a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cc3188-46eb-4741-9acb-cbe1b49b6e79]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1772cb9f-51a2-4754-a4e7-f5f8cbd0cc07]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance eec9ecbd-569c-46ec-9e74-3160c9ccd39f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 5933add2-b8bb-448d-a054-d8527e3c49f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 64c9f78b-8ce5-4328-9fb0-93715df6135f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance e96eb705-85e2-4cce-a91d-5d319b1b5083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance aefb432b-20b8-4c65-afd1-5ae501b80b43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d2c4575b-ef8d-4a9d-9650-459366b7227e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d4f158c3-bcd5-4d5b-8c70-04726b17081a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 872216e9-0900-4427-949e-a6fadef5afc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 1377f31d-9021-4cc1-9f36-c363d0a8bfda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:25:30 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[665a0913-8710-4a87-beba-3e1a08f2d0a0]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG os_brick.utils [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Updating existing volume attachment record: 0e107a1c-6195-42a0-b47b-9c9ad0c6b39d {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing inventories for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating ProviderTree inventory for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating inventory in ProviderTree for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing aggregate associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing trait associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:25:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.987s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-366053cb-2b48-4f9a-af85-8f5b5867866f req-ff3f2d11-d3ef-4ed5-ae50-acf1594cab6c service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received event network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-366053cb-2b48-4f9a-af85-8f5b5867866f req-ff3f2d11-d3ef-4ed5-ae50-acf1594cab6c service nova] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-366053cb-2b48-4f9a-af85-8f5b5867866f req-ff3f2d11-d3ef-4ed5-ae50-acf1594cab6c service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-366053cb-2b48-4f9a-af85-8f5b5867866f req-ff3f2d11-d3ef-4ed5-ae50-acf1594cab6c service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-366053cb-2b48-4f9a-af85-8f5b5867866f req-ff3f2d11-d3ef-4ed5-ae50-acf1594cab6c service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] No waiting events found dispatching network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:31 user nova-compute[75100]: WARNING nova.compute.manager [req-366053cb-2b48-4f9a-af85-8f5b5867866f req-ff3f2d11-d3ef-4ed5-ae50-acf1594cab6c service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received unexpected event network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 17:25:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-e738f437-c900-4753-be29-eac260eef221 req-9a78a019-0133-4f1c-b75d-ff864965f5b1 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received event network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e738f437-c900-4753-be29-eac260eef221 req-9a78a019-0133-4f1c-b75d-ff864965f5b1 service nova] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e738f437-c900-4753-be29-eac260eef221 req-9a78a019-0133-4f1c-b75d-ff864965f5b1 service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e738f437-c900-4753-be29-eac260eef221 req-9a78a019-0133-4f1c-b75d-ff864965f5b1 service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-e738f437-c900-4753-be29-eac260eef221 req-9a78a019-0133-4f1c-b75d-ff864965f5b1 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] No waiting events found dispatching network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:33 user nova-compute[75100]: WARNING nova.compute.manager [req-e738f437-c900-4753-be29-eac260eef221 req-9a78a019-0133-4f1c-b75d-ff864965f5b1 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received unexpected event network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:25:33 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Instance spawned successfully.
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:33 user nova-compute[75100]: DEBUG nova.objects.instance [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75100) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-57a1965d-65ea-417f-980c-feb8cb9c0bf1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZHygkoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:34 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:25:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:34 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:25:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:34 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee2a259-13cc-4aaf-937c-76da3d45898a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:25:34 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d9bf68-b0ae-4e0e-a8fc-ecd5a98498f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d] added
Nov 13 17:25:34 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22572da-6290-4821-b58e-98da81729a71]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0683a67e-1740-485b-874c-4a649c9c728e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZHygkoS {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZHygkoS" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dda1866-1174-4055-a0cb-3d7248ee38ae]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tZHygkoS'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b45a3bc-8a8d-4fe4-8ee8-1ba6ffe2ce80]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1066ee3f-7465-4f19-ad12-8c073798d812]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c588d603-ab83-46f3-bde2-65625b5e987a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d, portal: 172.16.0.220,3260]
Nov 13 17:25:35 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d, portal: 172.16.0.220,3260] successful.
Nov 13 17:25:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bd89a7-2a53-4246-a4bf-ba52580e8089]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddbac56-c670-4e28-b3a5-9c385d58af95]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d (non-flash)
Nov 13 17:25:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:35 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d (non-flash)
Nov 13 17:25:35 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f103106e-f275-4057-bea4-926e2ef82fec]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:25:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZHygkoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:25:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23262313366643133', 'path': '/dev/sdg'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262313366643133', 'path': '/dev/sdg'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:25:36 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lazy-loading 'flavor' on Instance uuid e96eb705-85e2-4cce-a91d-5d319b1b5083 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:25:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:25:36 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:25:36 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:25:36 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:25:36 user nova-compute[75100]:   <serial>4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d</serial>
Nov 13 17:25:36 user nova-compute[75100]: </disk>
Nov 13 17:25:36 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:25:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:25:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:25:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] No VIF found with MAC fa:16:3e:d0:59:f9, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:25:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f437102f-e9ed-46fd-8c32-e8650e472203 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.686s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:38 user nova-compute[75100]: INFO nova.compute.manager [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Detaching volume 4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d
Nov 13 17:25:38 user nova-compute[75100]: INFO nova.virt.block_device [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Attempting to driver detach volume 4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d from mountpoint /dev/vdb
Nov 13 17:25:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Attempting to detach device vdb from instance e96eb705-85e2-4cce-a91d-5d319b1b5083 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:25:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:25:38 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:25:38 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:25:38 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:25:38 user nova-compute[75100]:   <serial>4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d</serial>
Nov 13 17:25:38 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:25:38 user nova-compute[75100]: </disk>
Nov 13 17:25:38 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:25:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Successfully detached device vdb from instance e96eb705-85e2-4cce-a91d-5d319b1b5083 from the persistent domain config.
Nov 13 17:25:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e96eb705-85e2-4cce-a91d-5d319b1b5083 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:25:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:25:38 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:25:38 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:25:38 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:25:38 user nova-compute[75100]:   <serial>4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d</serial>
Nov 13 17:25:38 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:25:38 user nova-compute[75100]: </disk>
Nov 13 17:25:38 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:25:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e96eb705-85e2-4cce-a91d-5d319b1b5083 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:25:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Acquiring lock "aefb432b-20b8-4c65-afd1-5ae501b80b43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Acquiring lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:41 user nova-compute[75100]: INFO nova.compute.manager [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Terminating instance
Nov 13 17:25:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f2e4c71-f3b5-441a-a005-41ef1003ae0a req-79774129-fb9e-4892-af8a-9741337dad7e service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Received event network-vif-unplugged-47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f2e4c71-f3b5-441a-a005-41ef1003ae0a req-79774129-fb9e-4892-af8a-9741337dad7e service nova] Acquiring lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f2e4c71-f3b5-441a-a005-41ef1003ae0a req-79774129-fb9e-4892-af8a-9741337dad7e service nova] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f2e4c71-f3b5-441a-a005-41ef1003ae0a req-79774129-fb9e-4892-af8a-9741337dad7e service nova] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f2e4c71-f3b5-441a-a005-41ef1003ae0a req-79774129-fb9e-4892-af8a-9741337dad7e service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] No waiting events found dispatching network-vif-unplugged-47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f2e4c71-f3b5-441a-a005-41ef1003ae0a req-79774129-fb9e-4892-af8a-9741337dad7e service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Received event network-vif-unplugged-47696d52-ff5d-4d45-98a7-4eb625245cd6 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:25:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Instance destroyed successfully.
Nov 13 17:25:41 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lazy-loading 'resources' on Instance uuid aefb432b-20b8-4c65-afd1-5ae501b80b43 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:23:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1041673190',display_name='tempest-VolumesNegativeTest-instance-1041673190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1041673190',id=17,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:23:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ebb206190184bbbaeb0374709a23db3',ramdisk_id='',reservation_id='r-5gisqron',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-769849930',owner_user_name='tempest-VolumesNegativeTest-769849930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:23:58Z,user_data=None,user_id='a4def479d50d45bca64f521baf63659a',uuid=aefb432b-20b8-4c65-afd1-5ae501b80b43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "address": "fa:16:3e:0b:0d:65", "network": {"id": "434a6557-6cf1-4e57-876a-9847d13b383d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "458e9f65fc7f403d89d88b277a17b562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47696d52-ff", "ovs_interfaceid": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Converting VIF {"id": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "address": "fa:16:3e:0b:0d:65", "network": {"id": "434a6557-6cf1-4e57-876a-9847d13b383d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "458e9f65fc7f403d89d88b277a17b562", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47696d52-ff", "ovs_interfaceid": "47696d52-ff5d-4d45-98a7-4eb625245cd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0d:65,bridge_name='br-int',has_traffic_filtering=True,id=47696d52-ff5d-4d45-98a7-4eb625245cd6,network=Network(434a6557-6cf1-4e57-876a-9847d13b383d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47696d52-ff') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG os_vif [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0d:65,bridge_name='br-int',has_traffic_filtering=True,id=47696d52-ff5d-4d45-98a7-4eb625245cd6,network=Network(434a6557-6cf1-4e57-876a-9847d13b383d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47696d52-ff') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47696d52-ff, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:25:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88c80767-41a5-43ed-96ac-97f3c4afd95e) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:25:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:42 user nova-compute[75100]: INFO os_vif [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:0d:65,bridge_name='br-int',has_traffic_filtering=True,id=47696d52-ff5d-4d45-98a7-4eb625245cd6,network=Network(434a6557-6cf1-4e57-876a-9847d13b383d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47696d52-ff')
Nov 13 17:25:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Deleting instance files /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43_del
Nov 13 17:25:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Deletion of /opt/stack/data/nova/instances/aefb432b-20b8-4c65-afd1-5ae501b80b43_del complete
Nov 13 17:25:42 user nova-compute[75100]: INFO nova.compute.manager [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 13 17:25:42 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:25:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:42 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:25:42 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:25:42 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:25:42 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Took 0.37 seconds to deallocate network for instance.
Nov 13 17:25:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:42 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:25:42 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:25:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:42 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Deleted allocations for instance aefb432b-20b8-4c65-afd1-5ae501b80b43
Nov 13 17:25:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9f52c9db-1060-4a84-b2c4-c7fbc2a199c1 tempest-VolumesNegativeTest-769849930 tempest-VolumesNegativeTest-769849930-project-member] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.708s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4a2ca64-6da8-4c09-a788-340244a4b302 req-a38795a1-e0b4-484e-8121-cadba7ebf03e service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Received event network-vif-plugged-47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4a2ca64-6da8-4c09-a788-340244a4b302 req-a38795a1-e0b4-484e-8121-cadba7ebf03e service nova] Acquiring lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4a2ca64-6da8-4c09-a788-340244a4b302 req-a38795a1-e0b4-484e-8121-cadba7ebf03e service nova] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d4a2ca64-6da8-4c09-a788-340244a4b302 req-a38795a1-e0b4-484e-8121-cadba7ebf03e service nova] Lock "aefb432b-20b8-4c65-afd1-5ae501b80b43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4a2ca64-6da8-4c09-a788-340244a4b302 req-a38795a1-e0b4-484e-8121-cadba7ebf03e service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] No waiting events found dispatching network-vif-plugged-47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:43 user nova-compute[75100]: WARNING nova.compute.manager [req-d4a2ca64-6da8-4c09-a788-340244a4b302 req-a38795a1-e0b4-484e-8121-cadba7ebf03e service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Received unexpected event network-vif-plugged-47696d52-ff5d-4d45-98a7-4eb625245cd6 for instance with vm_state deleted and task_state None.
Nov 13 17:25:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-d4a2ca64-6da8-4c09-a788-340244a4b302 req-a38795a1-e0b4-484e-8121-cadba7ebf03e service nova] [instance: aefb432b-20b8-4c65-afd1-5ae501b80b43] Received event network-vif-deleted-47696d52-ff5d-4d45-98a7-4eb625245cd6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:58 user nova-compute[75100]: INFO nova.compute.manager [None req-aeadfbd4-532f-4104-9545-8be1589a12e4 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Unrescuing
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aeadfbd4-532f-4104-9545-8be1589a12e4 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aeadfbd4-532f-4104-9545-8be1589a12e4 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquired lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-aeadfbd4-532f-4104-9545-8be1589a12e4 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-aeadfbd4-532f-4104-9545-8be1589a12e4 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Updating instance_info_cache with network_info: [{"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aeadfbd4-532f-4104-9545-8be1589a12e4 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Releasing lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG nova.objects.instance [None req-aeadfbd4-532f-4104-9545-8be1589a12e4 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'flavor' on Instance uuid 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:58 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e96eb705-85e2-4cce-a91d-5d319b1b5083 is timed out.
Nov 13 17:25:58 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Successfully detached device vdb from instance e96eb705-85e2-4cce-a91d-5d319b1b5083 from the live domain config.
Nov 13 17:25:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZHygkoS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:25:58 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[011c6125-3191-4afd-822e-7849fe0b59be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:25:58 user nova-compute[75100]: No targets found.
Nov 13 17:25:58 user nova-compute[75100]: iSNS:
Nov 13 17:25:58 user nova-compute[75100]: No targets found.
Nov 13 17:25:58 user nova-compute[75100]: STATIC:
Nov 13 17:25:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4
Nov 13 17:25:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:25:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6
Nov 13 17:25:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d
Nov 13 17:25:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2
Nov 13 17:25:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e
Nov 13 17:25:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:25:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:25:58 user nova-compute[75100]: FIRMWARE:
Nov 13 17:25:58 user nova-compute[75100]: No targets found.
Nov 13 17:25:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:25:58 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:25:58 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e48ec29-a34c-48ea-88a0-65cce0bbd63b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[580b070d-e5c2-4777-ac55-71cb55734394]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:58 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:58 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:58 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:58 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:58 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d (non-flash)
Nov 13 17:25:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:25:58 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:25:58 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:25:58 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:25:58 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:25:58 user nova-compute[75100]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d (non-flash)
Nov 13 17:25:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38d42d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d'): ({'sdg'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Removing single pathed devices sdg {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-fc66248b-3fd5-4321-acb5-6bfc76e7e8d7 req-0a79099e-972a-4a16-86c5-fcea8232ac54 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-unplugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fc66248b-3fd5-4321-acb5-6bfc76e7e8d7 req-0a79099e-972a-4a16-86c5-fcea8232ac54 service nova] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fc66248b-3fd5-4321-acb5-6bfc76e7e8d7 req-0a79099e-972a-4a16-86c5-fcea8232ac54 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fc66248b-3fd5-4321-acb5-6bfc76e7e8d7 req-0a79099e-972a-4a16-86c5-fcea8232ac54 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-fc66248b-3fd5-4321-acb5-6bfc76e7e8d7 req-0a79099e-972a-4a16-86c5-fcea8232ac54 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] No waiting events found dispatching network-vif-unplugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:25:58 user nova-compute[75100]: WARNING nova.compute.manager [req-fc66248b-3fd5-4321-acb5-6bfc76e7e8d7 req-0a79099e-972a-4a16-86c5-fcea8232ac54 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received unexpected event network-vif-unplugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[60360e5b-879c-4060-9c10-83b75bfeae33]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9456c6-6131-48fd-a0f8-3e94e7f3c7ff]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Flushing IO for device /dev/sdg {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:25:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3b71c9-73ea-482c-8e17-760f5e62599f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94e3dba-74cb-4448-baaa-e5eba92361cc]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b71571-6a3a-47df-bcb0-f618e173322d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[881883b9-de77-404a-b8d1-754690f49499]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d, portal: 172.16.0.220,3260]
Nov 13 17:25:59 user nova-compute[75100]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d, portal: 172.16.0.220,3260] successful.
Nov 13 17:25:59 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d6a01df-2bd3-47c8-8b42-3a80cc3ac40d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f16f7f9-ca66-404d-9eda-5a6aba9a22e1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] <== disconnect_volume: return (356ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:25:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:25:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Instance destroyed successfully.
Nov 13 17:25:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lazy-loading 'flavor' on Instance uuid e96eb705-85e2-4cce-a91d-5d319b1b5083 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:26:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-381322b8-04d3-4e20-9e9c-f60cf0299791 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.795s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3d241e2-da41-458b-b390-f0edadd57a2c req-f6a64cb8-a296-42da-b57e-b973454c06b5 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3d241e2-da41-458b-b390-f0edadd57a2c req-f6a64cb8-a296-42da-b57e-b973454c06b5 service nova] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3d241e2-da41-458b-b390-f0edadd57a2c req-f6a64cb8-a296-42da-b57e-b973454c06b5 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3d241e2-da41-458b-b390-f0edadd57a2c req-f6a64cb8-a296-42da-b57e-b973454c06b5 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3d241e2-da41-458b-b390-f0edadd57a2c req-f6a64cb8-a296-42da-b57e-b973454c06b5 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] No waiting events found dispatching network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:01 user nova-compute[75100]: WARNING nova.compute.manager [req-f3d241e2-da41-458b-b390-f0edadd57a2c req-f6a64cb8-a296-42da-b57e-b973454c06b5 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received unexpected event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:26:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-aeadfbd4-532f-4104-9545-8be1589a12e4 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:26:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-47569af3-d2b1-45ea-90c9-3a48d5061233 req-a08896ee-a789-41cb-94cc-b84c7bcd1543 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-47569af3-d2b1-45ea-90c9-3a48d5061233 req-a08896ee-a789-41cb-94cc-b84c7bcd1543 service nova] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-47569af3-d2b1-45ea-90c9-3a48d5061233 req-a08896ee-a789-41cb-94cc-b84c7bcd1543 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-47569af3-d2b1-45ea-90c9-3a48d5061233 req-a08896ee-a789-41cb-94cc-b84c7bcd1543 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-47569af3-d2b1-45ea-90c9-3a48d5061233 req-a08896ee-a789-41cb-94cc-b84c7bcd1543 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] No waiting events found dispatching network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:03 user nova-compute[75100]: WARNING nova.compute.manager [req-47569af3-d2b1-45ea-90c9-3a48d5061233 req-a08896ee-a789-41cb-94cc-b84c7bcd1543 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received unexpected event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 for instance with vm_state active and task_state None.
Nov 13 17:26:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-47569af3-d2b1-45ea-90c9-3a48d5061233 req-a08896ee-a789-41cb-94cc-b84c7bcd1543 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-47569af3-d2b1-45ea-90c9-3a48d5061233 req-a08896ee-a789-41cb-94cc-b84c7bcd1543 service nova] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-47569af3-d2b1-45ea-90c9-3a48d5061233 req-a08896ee-a789-41cb-94cc-b84c7bcd1543 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-47569af3-d2b1-45ea-90c9-3a48d5061233 req-a08896ee-a789-41cb-94cc-b84c7bcd1543 service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-47569af3-d2b1-45ea-90c9-3a48d5061233 req-a08896ee-a789-41cb-94cc-b84c7bcd1543 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] No waiting events found dispatching network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:03 user nova-compute[75100]: WARNING nova.compute.manager [req-47569af3-d2b1-45ea-90c9-3a48d5061233 req-a08896ee-a789-41cb-94cc-b84c7bcd1543 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received unexpected event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 for instance with vm_state active and task_state None.
Nov 13 17:26:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-fa838d2e-ca8a-4638-9283-5ab7c2fb98f9 req-3fe99dc3-1d12-45b2-942a-42fcc94f1323 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-changed-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-fa838d2e-ca8a-4638-9283-5ab7c2fb98f9 req-3fe99dc3-1d12-45b2-942a-42fcc94f1323 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Refreshing instance network info cache due to event network-changed-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:26:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fa838d2e-ca8a-4638-9283-5ab7c2fb98f9 req-3fe99dc3-1d12-45b2-942a-42fcc94f1323 service nova] Acquiring lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:26:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fa838d2e-ca8a-4638-9283-5ab7c2fb98f9 req-3fe99dc3-1d12-45b2-942a-42fcc94f1323 service nova] Acquired lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:26:07 user nova-compute[75100]: DEBUG nova.network.neutron [req-fa838d2e-ca8a-4638-9283-5ab7c2fb98f9 req-3fe99dc3-1d12-45b2-942a-42fcc94f1323 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Refreshing network info cache for port 0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:26:07 user nova-compute[75100]: DEBUG nova.network.neutron [req-fa838d2e-ca8a-4638-9283-5ab7c2fb98f9 req-3fe99dc3-1d12-45b2-942a-42fcc94f1323 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Updated VIF entry in instance network info cache for port 0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:26:07 user nova-compute[75100]: DEBUG nova.network.neutron [req-fa838d2e-ca8a-4638-9283-5ab7c2fb98f9 req-3fe99dc3-1d12-45b2-942a-42fcc94f1323 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Updating instance_info_cache with network_info: [{"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:26:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fa838d2e-ca8a-4638-9283-5ab7c2fb98f9 req-3fe99dc3-1d12-45b2-942a-42fcc94f1323 service nova] Releasing lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:26:09 user nova-compute[75100]: INFO nova.compute.manager [None req-aff73633-18f6-42d5-86a2-f394593612c9 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Unrescuing
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aff73633-18f6-42d5-86a2-f394593612c9 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aff73633-18f6-42d5-86a2-f394593612c9 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquired lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG nova.network.neutron [None req-aff73633-18f6-42d5-86a2-f394593612c9 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:09 user nova-compute[75100]: INFO nova.compute.manager [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Attaching volume 96d5831f-9831-46ee-a088-fcd53a8b9e12 to /dev/vdb
Nov 13 17:26:09 user nova-compute[75100]: DEBUG os_brick.utils [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7f257b-8c9c-46f4-b9cc-20647bfb430f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb2b1c1-d5e5-475d-b3c9-114058f4b869]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe4efee-7c70-47cc-ac16-130170250ef2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c88ec66-4195-44c5-be95-38279a679c3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:26:09 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d78371-e73c-4737-82e9-906fcc95f2df]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG os_brick.utils [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Updating existing volume attachment record: f666f44a-c9ee-492c-aacb-a0470bff2474 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG nova.network.neutron [None req-aff73633-18f6-42d5-86a2-f394593612c9 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Updating instance_info_cache with network_info: [{"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aff73633-18f6-42d5-86a2-f394593612c9 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Releasing lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG nova.objects.instance [None req-aff73633-18f6-42d5-86a2-f394593612c9 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'flavor' on Instance uuid 83d28254-9d5f-4190-85de-76f5a2b69dac {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-4c66f4e6-95c8-4113-b0f6-170444190fa8 req-f0578e02-0473-4154-8335-227dae5d6334 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-unplugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4c66f4e6-95c8-4113-b0f6-170444190fa8 req-f0578e02-0473-4154-8335-227dae5d6334 service nova] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4c66f4e6-95c8-4113-b0f6-170444190fa8 req-f0578e02-0473-4154-8335-227dae5d6334 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4c66f4e6-95c8-4113-b0f6-170444190fa8 req-f0578e02-0473-4154-8335-227dae5d6334 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-4c66f4e6-95c8-4113-b0f6-170444190fa8 req-f0578e02-0473-4154-8335-227dae5d6334 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] No waiting events found dispatching network-vif-unplugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:10 user nova-compute[75100]: WARNING nova.compute.manager [req-4c66f4e6-95c8-4113-b0f6-170444190fa8 req-f0578e02-0473-4154-8335-227dae5d6334 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received unexpected event network-vif-unplugged-d15270b0-a020-4fc1-bac3-3ea3da038478 for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:26:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Instance destroyed successfully.
Nov 13 17:26:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:26:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-28f1ce76-9bbb-4c8d-a108-0fe0bcb5e358 req-6c545ed7-a36c-4218-b264-7e3903725f80 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-28f1ce76-9bbb-4c8d-a108-0fe0bcb5e358 req-6c545ed7-a36c-4218-b264-7e3903725f80 service nova] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-28f1ce76-9bbb-4c8d-a108-0fe0bcb5e358 req-6c545ed7-a36c-4218-b264-7e3903725f80 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-28f1ce76-9bbb-4c8d-a108-0fe0bcb5e358 req-6c545ed7-a36c-4218-b264-7e3903725f80 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-28f1ce76-9bbb-4c8d-a108-0fe0bcb5e358 req-6c545ed7-a36c-4218-b264-7e3903725f80 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] No waiting events found dispatching network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:12 user nova-compute[75100]: WARNING nova.compute.manager [req-28f1ce76-9bbb-4c8d-a108-0fe0bcb5e358 req-6c545ed7-a36c-4218-b264-7e3903725f80 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received unexpected event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-28f1ce76-9bbb-4c8d-a108-0fe0bcb5e358 req-6c545ed7-a36c-4218-b264-7e3903725f80 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-28f1ce76-9bbb-4c8d-a108-0fe0bcb5e358 req-6c545ed7-a36c-4218-b264-7e3903725f80 service nova] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-28f1ce76-9bbb-4c8d-a108-0fe0bcb5e358 req-6c545ed7-a36c-4218-b264-7e3903725f80 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-28f1ce76-9bbb-4c8d-a108-0fe0bcb5e358 req-6c545ed7-a36c-4218-b264-7e3903725f80 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-28f1ce76-9bbb-4c8d-a108-0fe0bcb5e358 req-6c545ed7-a36c-4218-b264-7e3903725f80 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] No waiting events found dispatching network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:12 user nova-compute[75100]: WARNING nova.compute.manager [req-28f1ce76-9bbb-4c8d-a108-0fe0bcb5e358 req-6c545ed7-a36c-4218-b264-7e3903725f80 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received unexpected event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:26:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 7f3f3c5b-5128-4356-a995-fe3265f49fe1 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid b0c1af59-f1bd-4c02-8843-e477cd7169d8 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 64c9f78b-8ce5-4328-9fb0-93715df6135f {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 83d28254-9d5f-4190-85de-76f5a2b69dac {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid eec9ecbd-569c-46ec-9e74-3160c9ccd39f {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid e96eb705-85e2-4cce-a91d-5d319b1b5083 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 872216e9-0900-4427-949e-a6fadef5afc9 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 1377f31d-9021-4cc1-9f36-c363d0a8bfda {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 5933add2-b8bb-448d-a054-d8527e3c49f8 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: INFO nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "872216e9-0900-4427-949e-a6fadef5afc9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "872216e9-0900-4427-949e-a6fadef5afc9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:12 user nova-compute[75100]: WARNING oslo_messaging._drivers.amqpdriver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "872216e9-0900-4427-949e-a6fadef5afc9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.137s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.142s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.153s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.159s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.169s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.173s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.165s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkbQJzAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:26:13 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:26:13 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:26:13 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca37ce6a-fab2-4b9e-982f-18e19d282888]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:26:13 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca166a10-1fa2-4c06-9176-6d205ffb3c38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12] added
Nov 13 17:26:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d501d90a-ff48-451c-98fa-7c4a5baaf034]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92409b1-8a68-4052-a3c5-26ca8d924986]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XkbQJzAD {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XkbQJzAD" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f358d7-2f64-456c-b8a1-d0bec7bf4eb2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XkbQJzAD'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06b9123-f5e9-4cc2-ba2d-7272cc9e00dd]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab64e64-b197-4c1e-9abf-d2dd06ba54ee]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:26:13 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:26:13 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:26:13 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:26:13 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:26:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:26:13 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:26:13 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:26:13 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:26:13 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:26:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:26:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[576d113e-2209-48b0-9299-33a08751a6d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260]
Nov 13 17:26:14 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260] successful.
Nov 13 17:26:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[832b9bc0-bed8-43e9-85f6-078a56b3e9b1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bf7384-a425-4f62-bc75-09e4a3cb06ee]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:26:14 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:26:14 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:26:14 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:26:14 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:26:14 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:26:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:26:14 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:26:14 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:26:14 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:26:14 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:26:14 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:26:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff845f0c-c726-40ab-871b-03ca90ca2b42]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-aff73633-18f6-42d5-86a2-f394593612c9 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-a2e09e04-9381-4978-af6b-16fea1709c30 req-9c6f50e7-32db-447c-8a2c-1cb653382300 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a2e09e04-9381-4978-af6b-16fea1709c30 req-9c6f50e7-32db-447c-8a2c-1cb653382300 service nova] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a2e09e04-9381-4978-af6b-16fea1709c30 req-9c6f50e7-32db-447c-8a2c-1cb653382300 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a2e09e04-9381-4978-af6b-16fea1709c30 req-9c6f50e7-32db-447c-8a2c-1cb653382300 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-a2e09e04-9381-4978-af6b-16fea1709c30 req-9c6f50e7-32db-447c-8a2c-1cb653382300 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] No waiting events found dispatching network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:14 user nova-compute[75100]: WARNING nova.compute.manager [req-a2e09e04-9381-4978-af6b-16fea1709c30 req-9c6f50e7-32db-447c-8a2c-1cb653382300 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received unexpected event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 for instance with vm_state active and task_state None.
Nov 13 17:26:15 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:26:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkbQJzAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:26:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:26:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26434373331613136', 'path': '/dev/sdg'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:26:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434373331613136', 'path': '/dev/sdg'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:26:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:26:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:26:15 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:26:15 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:26:15 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:26:15 user nova-compute[75100]:   <serial>96d5831f-9831-46ee-a088-fcd53a8b9e12</serial>
Nov 13 17:26:15 user nova-compute[75100]: </disk>
Nov 13 17:26:15 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:26:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:26:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:26:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No VIF found with MAC fa:16:3e:00:52:b6, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:26:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e10eb5ed-25d1-452c-b51c-9d9900ae1cbc tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.402s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.502s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4c5f64d7-5544-4cae-8402-08ad9634460f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4c5f64d7-5544-4cae-8402-08ad9634460f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4c5f64d7-5544-4cae-8402-08ad9634460f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4c5f64d7-5544-4cae-8402-08ad9634460f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75100) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4c5f64d7-5544-4cae-8402-08ad9634460f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-0c9d257e-1298-4b7a-8e88-449f4cc47616 req-5590c9be-a65b-4434-abb7-1aa58ab57175 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-unplugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0c9d257e-1298-4b7a-8e88-449f4cc47616 req-5590c9be-a65b-4434-abb7-1aa58ab57175 service nova] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0c9d257e-1298-4b7a-8e88-449f4cc47616 req-5590c9be-a65b-4434-abb7-1aa58ab57175 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0c9d257e-1298-4b7a-8e88-449f4cc47616 req-5590c9be-a65b-4434-abb7-1aa58ab57175 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-0c9d257e-1298-4b7a-8e88-449f4cc47616 req-5590c9be-a65b-4434-abb7-1aa58ab57175 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] No waiting events found dispatching network-vif-unplugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:16 user nova-compute[75100]: WARNING nova.compute.manager [req-0c9d257e-1298-4b7a-8e88-449f4cc47616 req-5590c9be-a65b-4434-abb7-1aa58ab57175 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received unexpected event network-vif-unplugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd for instance with vm_state active and task_state powering-off.
Nov 13 17:26:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance destroyed successfully.
Nov 13 17:26:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4c5f64d7-5544-4cae-8402-08ad9634460f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:26:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4c5f64d7-5544-4cae-8402-08ad9634460f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.847s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-1103c7dd-c3af-48b0-8338-72624ba70158 req-6be56065-90a9-4773-bc27-501993a2282a service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1103c7dd-c3af-48b0-8338-72624ba70158 req-6be56065-90a9-4773-bc27-501993a2282a service nova] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1103c7dd-c3af-48b0-8338-72624ba70158 req-6be56065-90a9-4773-bc27-501993a2282a service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1103c7dd-c3af-48b0-8338-72624ba70158 req-6be56065-90a9-4773-bc27-501993a2282a service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-1103c7dd-c3af-48b0-8338-72624ba70158 req-6be56065-90a9-4773-bc27-501993a2282a service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] No waiting events found dispatching network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:18 user nova-compute[75100]: WARNING nova.compute.manager [req-1103c7dd-c3af-48b0-8338-72624ba70158 req-6be56065-90a9-4773-bc27-501993a2282a service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received unexpected event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd for instance with vm_state stopped and task_state None.
Nov 13 17:26:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:26:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:26:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:26:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:26:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:26:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 17:26:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:26:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:26:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:26:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:21 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:26:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.315s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:26:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:26:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:26:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:26:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:26:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:26:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7094MB free_disk=25.249683380126953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance eec9ecbd-569c-46ec-9e74-3160c9ccd39f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 5933add2-b8bb-448d-a054-d8527e3c49f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 64c9f78b-8ce5-4328-9fb0-93715df6135f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance e96eb705-85e2-4cce-a91d-5d319b1b5083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d2c4575b-ef8d-4a9d-9650-459366b7227e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d4f158c3-bcd5-4d5b-8c70-04726b17081a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 872216e9-0900-4427-949e-a6fadef5afc9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 1377f31d-9021-4cc1-9f36-c363d0a8bfda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:26:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:26:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:26:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:26:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:26:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:29 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:26:29 user nova-compute[75100]: INFO nova.compute.claims [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Claim successful on node user
Nov 13 17:26:30 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:26:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:26:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG nova.policy [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4bb17b2fc6a4406ca5c476d267ff6f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6052793c6f6e40ce9f63a04a0afd609f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:26:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Creating image(s)
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "/opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "/opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk 1073741824" returned: 0 in 0.051s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Successfully created port: a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:26:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Cannot resize image /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Ensure instance console log exists: /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Successfully updated port: a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "refresh_cache-9ef6e164-8da5-49b1-b1a7-7eff19aef9fa" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquired lock "refresh_cache-9ef6e164-8da5-49b1-b1a7-7eff19aef9fa" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-bc3ceda9-2d00-435c-b1aa-5b98883756e6 req-331829dc-aa22-4695-93fb-6fe6c7825a24 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Received event network-changed-a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-bc3ceda9-2d00-435c-b1aa-5b98883756e6 req-331829dc-aa22-4695-93fb-6fe6c7825a24 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Refreshing instance network info cache due to event network-changed-a9932400-67ab-4509-adbc-f802c060e33e. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bc3ceda9-2d00-435c-b1aa-5b98883756e6 req-331829dc-aa22-4695-93fb-6fe6c7825a24 service nova] Acquiring lock "refresh_cache-9ef6e164-8da5-49b1-b1a7-7eff19aef9fa" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Updating instance_info_cache with network_info: [{"id": "a9932400-67ab-4509-adbc-f802c060e33e", "address": "fa:16:3e:ec:d7:bb", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9932400-67", "ovs_interfaceid": "a9932400-67ab-4509-adbc-f802c060e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Releasing lock "refresh_cache-9ef6e164-8da5-49b1-b1a7-7eff19aef9fa" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Instance network_info: |[{"id": "a9932400-67ab-4509-adbc-f802c060e33e", "address": "fa:16:3e:ec:d7:bb", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9932400-67", "ovs_interfaceid": "a9932400-67ab-4509-adbc-f802c060e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bc3ceda9-2d00-435c-b1aa-5b98883756e6 req-331829dc-aa22-4695-93fb-6fe6c7825a24 service nova] Acquired lock "refresh_cache-9ef6e164-8da5-49b1-b1a7-7eff19aef9fa" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-bc3ceda9-2d00-435c-b1aa-5b98883756e6 req-331829dc-aa22-4695-93fb-6fe6c7825a24 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Refreshing network info cache for port a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Start _get_guest_xml network_info=[{"id": "a9932400-67ab-4509-adbc-f802c060e33e", "address": "fa:16:3e:ec:d7:bb", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9932400-67", "ovs_interfaceid": "a9932400-67ab-4509-adbc-f802c060e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:26:31 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:26:31 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1075897505',display_name='tempest-VolumesAdminNegativeTest-server-1075897505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1075897505',id=22,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6052793c6f6e40ce9f63a04a0afd609f',ramdisk_id='',reservation_id='r-1s1hmxtf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-57814532',owner_user_name='tempest-VolumesAdminNegativeTest-57814532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:26:30Z,user_data=None,user_id='4bb17b2fc6a4406ca5c476d267ff6f2a',uuid=9ef6e164-8da5-49b1-b1a7-7eff19aef9fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9932400-67ab-4509-adbc-f802c060e33e", "address": "fa:16:3e:ec:d7:bb", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9932400-67", "ovs_interfaceid": "a9932400-67ab-4509-adbc-f802c060e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Converting VIF {"id": "a9932400-67ab-4509-adbc-f802c060e33e", "address": "fa:16:3e:ec:d7:bb", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9932400-67", "ovs_interfaceid": "a9932400-67ab-4509-adbc-f802c060e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d7:bb,bridge_name='br-int',has_traffic_filtering=True,id=a9932400-67ab-4509-adbc-f802c060e33e,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9932400-67') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:26:31 user nova-compute[75100]:   <uuid>9ef6e164-8da5-49b1-b1a7-7eff19aef9fa</uuid>
Nov 13 17:26:31 user nova-compute[75100]:   <name>instance-00000016</name>
Nov 13 17:26:31 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:26:31 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:26:31 user nova-compute[75100]:   <metadata>
Nov 13 17:26:31 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:26:31 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:26:31 user nova-compute[75100]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1075897505</nova:name>
Nov 13 17:26:31 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:26:31</nova:creationTime>
Nov 13 17:26:31 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:26:31 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:26:31 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:26:31 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:26:31 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:26:31 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:26:31 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:26:31 user nova-compute[75100]:       <nova:owner>
Nov 13 17:26:31 user nova-compute[75100]:         <nova:user uuid="4bb17b2fc6a4406ca5c476d267ff6f2a">tempest-VolumesAdminNegativeTest-57814532-project-member</nova:user>
Nov 13 17:26:31 user nova-compute[75100]:         <nova:project uuid="6052793c6f6e40ce9f63a04a0afd609f">tempest-VolumesAdminNegativeTest-57814532</nova:project>
Nov 13 17:26:31 user nova-compute[75100]:       </nova:owner>
Nov 13 17:26:31 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:26:31 user nova-compute[75100]:       <nova:ports>
Nov 13 17:26:31 user nova-compute[75100]:         <nova:port uuid="a9932400-67ab-4509-adbc-f802c060e33e">
Nov 13 17:26:31 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 17:26:31 user nova-compute[75100]:         </nova:port>
Nov 13 17:26:31 user nova-compute[75100]:       </nova:ports>
Nov 13 17:26:31 user nova-compute[75100]:     </nova:instance>
Nov 13 17:26:31 user nova-compute[75100]:   </metadata>
Nov 13 17:26:31 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:26:31 user nova-compute[75100]:     <system>
Nov 13 17:26:31 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:26:31 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:26:31 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:26:31 user nova-compute[75100]:       <entry name="serial">9ef6e164-8da5-49b1-b1a7-7eff19aef9fa</entry>
Nov 13 17:26:31 user nova-compute[75100]:       <entry name="uuid">9ef6e164-8da5-49b1-b1a7-7eff19aef9fa</entry>
Nov 13 17:26:31 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:26:31 user nova-compute[75100]:     </system>
Nov 13 17:26:31 user nova-compute[75100]:   </sysinfo>
Nov 13 17:26:31 user nova-compute[75100]:   <os>
Nov 13 17:26:31 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:26:31 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:26:31 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:26:31 user nova-compute[75100]:   </os>
Nov 13 17:26:31 user nova-compute[75100]:   <features>
Nov 13 17:26:31 user nova-compute[75100]:     <acpi/>
Nov 13 17:26:31 user nova-compute[75100]:     <apic/>
Nov 13 17:26:31 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:26:31 user nova-compute[75100]:   </features>
Nov 13 17:26:31 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:26:31 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:26:31 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:26:31 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:26:31 user nova-compute[75100]:   </clock>
Nov 13 17:26:31 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:26:31 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:26:31 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:26:31 user nova-compute[75100]:   </cpu>
Nov 13 17:26:31 user nova-compute[75100]:   <devices>
Nov 13 17:26:31 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:26:31 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:26:31 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk"/>
Nov 13 17:26:31 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:26:31 user nova-compute[75100]:     </disk>
Nov 13 17:26:31 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:26:31 user nova-compute[75100]:       <mac address="fa:16:3e:ec:d7:bb"/>
Nov 13 17:26:31 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:26:31 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:26:31 user nova-compute[75100]:       <target dev="tapa9932400-67"/>
Nov 13 17:26:31 user nova-compute[75100]:     </interface>
Nov 13 17:26:31 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:26:31 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/console.log" append="off"/>
Nov 13 17:26:31 user nova-compute[75100]:     </serial>
Nov 13 17:26:31 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:26:31 user nova-compute[75100]:     <video>
Nov 13 17:26:31 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:26:31 user nova-compute[75100]:     </video>
Nov 13 17:26:31 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:26:31 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:26:31 user nova-compute[75100]:     </rng>
Nov 13 17:26:31 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:26:31 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:26:31 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:26:31 user nova-compute[75100]:     </memballoon>
Nov 13 17:26:31 user nova-compute[75100]:   </devices>
Nov 13 17:26:31 user nova-compute[75100]: </domain>
Nov 13 17:26:31 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1075897505',display_name='tempest-VolumesAdminNegativeTest-server-1075897505',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1075897505',id=22,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6052793c6f6e40ce9f63a04a0afd609f',ramdisk_id='',reservation_id='r-1s1hmxtf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-57814532',owner_user_name='tempest-VolumesAdminNegativeTest-57814532-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:26:30Z,user_data=None,user_id='4bb17b2fc6a4406ca5c476d267ff6f2a',uuid=9ef6e164-8da5-49b1-b1a7-7eff19aef9fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9932400-67ab-4509-adbc-f802c060e33e", "address": "fa:16:3e:ec:d7:bb", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9932400-67", "ovs_interfaceid": "a9932400-67ab-4509-adbc-f802c060e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Converting VIF {"id": "a9932400-67ab-4509-adbc-f802c060e33e", "address": "fa:16:3e:ec:d7:bb", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9932400-67", "ovs_interfaceid": "a9932400-67ab-4509-adbc-f802c060e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d7:bb,bridge_name='br-int',has_traffic_filtering=True,id=a9932400-67ab-4509-adbc-f802c060e33e,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9932400-67') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG os_vif [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d7:bb,bridge_name='br-int',has_traffic_filtering=True,id=a9932400-67ab-4509-adbc-f802c060e33e,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9932400-67') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6accdf23-985f-5f7c-a21f-d7839e3f3320', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9932400-67, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9932400-67, col_values=(('qos', UUID('7e5c3553-832b-4955-b020-7126d2777ea6')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9932400-67, col_values=(('external_ids', {'iface-id': 'a9932400-67ab-4509-adbc-f802c060e33e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:d7:bb', 'vm-uuid': '9ef6e164-8da5-49b1-b1a7-7eff19aef9fa'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:26:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:31 user nova-compute[75100]: INFO os_vif [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d7:bb,bridge_name='br-int',has_traffic_filtering=True,id=a9932400-67ab-4509-adbc-f802c060e33e,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9932400-67')
Nov 13 17:26:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:26:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] No VIF found with MAC fa:16:3e:ec:d7:bb, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:26:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-bc3ceda9-2d00-435c-b1aa-5b98883756e6 req-331829dc-aa22-4695-93fb-6fe6c7825a24 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Updated VIF entry in instance network info cache for port a9932400-67ab-4509-adbc-f802c060e33e. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:26:32 user nova-compute[75100]: DEBUG nova.network.neutron [req-bc3ceda9-2d00-435c-b1aa-5b98883756e6 req-331829dc-aa22-4695-93fb-6fe6c7825a24 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Updating instance_info_cache with network_info: [{"id": "a9932400-67ab-4509-adbc-f802c060e33e", "address": "fa:16:3e:ec:d7:bb", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9932400-67", "ovs_interfaceid": "a9932400-67ab-4509-adbc-f802c060e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:26:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bc3ceda9-2d00-435c-b1aa-5b98883756e6 req-331829dc-aa22-4695-93fb-6fe6c7825a24 service nova] Releasing lock "refresh_cache-9ef6e164-8da5-49b1-b1a7-7eff19aef9fa" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:26:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-dc3ca162-4f55-45d0-9adb-c6629e8fe869 req-153926d0-2299-442b-a7ab-8d8d6081f179 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Received event network-vif-plugged-a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-dc3ca162-4f55-45d0-9adb-c6629e8fe869 req-153926d0-2299-442b-a7ab-8d8d6081f179 service nova] Acquiring lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-dc3ca162-4f55-45d0-9adb-c6629e8fe869 req-153926d0-2299-442b-a7ab-8d8d6081f179 service nova] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-dc3ca162-4f55-45d0-9adb-c6629e8fe869 req-153926d0-2299-442b-a7ab-8d8d6081f179 service nova] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-dc3ca162-4f55-45d0-9adb-c6629e8fe869 req-153926d0-2299-442b-a7ab-8d8d6081f179 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] No waiting events found dispatching network-vif-plugged-a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:33 user nova-compute[75100]: WARNING nova.compute.manager [req-dc3ca162-4f55-45d0-9adb-c6629e8fe869 req-153926d0-2299-442b-a7ab-8d8d6081f179 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Received unexpected event network-vif-plugged-a9932400-67ab-4509-adbc-f802c060e33e for instance with vm_state building and task_state spawning.
Nov 13 17:26:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-fed1c87e-ba52-4e5b-ad59-4cd7428ced22 req-3d34fa68-fc98-4354-9ee9-b01b15ae05ef service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Received event network-changed-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-fed1c87e-ba52-4e5b-ad59-4cd7428ced22 req-3d34fa68-fc98-4354-9ee9-b01b15ae05ef service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Refreshing instance network info cache due to event network-changed-a8f33ad4-03cc-4458-b977-d8db6b1aeb30. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:26:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fed1c87e-ba52-4e5b-ad59-4cd7428ced22 req-3d34fa68-fc98-4354-9ee9-b01b15ae05ef service nova] Acquiring lock "refresh_cache-d4f158c3-bcd5-4d5b-8c70-04726b17081a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:26:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fed1c87e-ba52-4e5b-ad59-4cd7428ced22 req-3d34fa68-fc98-4354-9ee9-b01b15ae05ef service nova] Acquired lock "refresh_cache-d4f158c3-bcd5-4d5b-8c70-04726b17081a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:26:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-fed1c87e-ba52-4e5b-ad59-4cd7428ced22 req-3d34fa68-fc98-4354-9ee9-b01b15ae05ef service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Refreshing network info cache for port a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-fed1c87e-ba52-4e5b-ad59-4cd7428ced22 req-3d34fa68-fc98-4354-9ee9-b01b15ae05ef service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Updated VIF entry in instance network info cache for port a8f33ad4-03cc-4458-b977-d8db6b1aeb30. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-fed1c87e-ba52-4e5b-ad59-4cd7428ced22 req-3d34fa68-fc98-4354-9ee9-b01b15ae05ef service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Updating instance_info_cache with network_info: [{"id": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "address": "fa:16:3e:0b:72:c0", "network": {"id": "09e96b0d-2707-43df-806a-5b8b09f24843", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1641478356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1275e18265645a7a2f9be240c26cc36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f33ad4-03", "ovs_interfaceid": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fed1c87e-ba52-4e5b-ad59-4cd7428ced22 req-3d34fa68-fc98-4354-9ee9-b01b15ae05ef service nova] Releasing lock "refresh_cache-d4f158c3-bcd5-4d5b-8c70-04726b17081a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:26:35 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Instance spawned successfully.
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:26:35 user nova-compute[75100]: INFO nova.compute.manager [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-f89f093f-ffba-4180-b0d1-60f7615fc405 req-bb08c04f-38b4-4cb4-ba5e-520a0fab0fe7 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Received event network-vif-plugged-a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f89f093f-ffba-4180-b0d1-60f7615fc405 req-bb08c04f-38b4-4cb4-ba5e-520a0fab0fe7 service nova] Acquiring lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f89f093f-ffba-4180-b0d1-60f7615fc405 req-bb08c04f-38b4-4cb4-ba5e-520a0fab0fe7 service nova] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f89f093f-ffba-4180-b0d1-60f7615fc405 req-bb08c04f-38b4-4cb4-ba5e-520a0fab0fe7 service nova] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-f89f093f-ffba-4180-b0d1-60f7615fc405 req-bb08c04f-38b4-4cb4-ba5e-520a0fab0fe7 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] No waiting events found dispatching network-vif-plugged-a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:35 user nova-compute[75100]: WARNING nova.compute.manager [req-f89f093f-ffba-4180-b0d1-60f7615fc405 req-bb08c04f-38b4-4cb4-ba5e-520a0fab0fe7 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Received unexpected event network-vif-plugged-a9932400-67ab-4509-adbc-f802c060e33e for instance with vm_state building and task_state spawning.
Nov 13 17:26:35 user nova-compute[75100]: INFO nova.compute.manager [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Took 5.93 seconds to build instance.
Nov 13 17:26:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7d8ca40e-f5cd-4ce2-a503-8574b710d0cb tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.023s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'flavor' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:37 user nova-compute[75100]: INFO nova.compute.manager [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attaching volume 60927720-11e9-46a8-9ce6-09ca1dff3396 to /dev/vdb
Nov 13 17:26:37 user nova-compute[75100]: DEBUG os_brick.utils [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf383f6-bde4-4eb2-b975-41b46ebe54f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0faae8-29ab-4f80-ac04-971981ea34b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bb198a-a892-4afc-9d39-931aa209fcfa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3d75fa-e445-4b1b-bc28-3b3cf59fcfc8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:26:37 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:26:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a341e8-06ce-4462-8a76-8065a1e8f6b0]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG os_brick.utils [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:26:37 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Updating existing volume attachment record: 9199a6a7-3d3a-4527-a19f-7a4ad337e3a9 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:26:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtgJaQOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:26:42 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:26:42 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:26:42 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0321b3c-17b1-4035-a28d-f6ba30e811f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:26:42 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb323de-2ed9-4848-942b-b28e141ca9fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396] added
Nov 13 17:26:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ed2c5c-6cf9-48c6-9127-63a0f0db2821]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6f2288-ab37-4b22-8bcc-f4d91bd93a92]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtgJaQOI {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LtgJaQOI" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac1fa92-c843-4514-9609-22b5e6d7dda1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LtgJaQOI'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fd364a-4637-4eb6-9de3-69d7a7c67957]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[87843f18-8d6d-4194-93aa-e12dc618cecc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5611f48-39be-4886-97f1-eb761c06a438]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396, portal: 172.16.0.220,3260]
Nov 13 17:26:42 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396, portal: 172.16.0.220,3260] successful.
Nov 13 17:26:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c6f735-01f2-4d4d-ba43-cb32b24a65f4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a29ddbe-9f4b-4079-b6f5-aa64abd5fb20]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 (non-flash)
Nov 13 17:26:42 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] HCTL ('39', '-', '-', 0) found on session 25 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ea458d-c101-4761-997d-2e26bb8d62a3]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Searching for a device in session 25 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:26:42 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtgJaQOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:26:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-f5cdcda1-33e9-47ef-976f-c6a5ddab232a req-f77646fc-e448-470a-b3f2-6c6f7d23ceba service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Received event network-changed-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-f5cdcda1-33e9-47ef-976f-c6a5ddab232a req-f77646fc-e448-470a-b3f2-6c6f7d23ceba service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Refreshing instance network info cache due to event network-changed-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:26:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f5cdcda1-33e9-47ef-976f-c6a5ddab232a req-f77646fc-e448-470a-b3f2-6c6f7d23ceba service nova] Acquiring lock "refresh_cache-872216e9-0900-4427-949e-a6fadef5afc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:26:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f5cdcda1-33e9-47ef-976f-c6a5ddab232a req-f77646fc-e448-470a-b3f2-6c6f7d23ceba service nova] Acquired lock "refresh_cache-872216e9-0900-4427-949e-a6fadef5afc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:26:43 user nova-compute[75100]: DEBUG nova.network.neutron [req-f5cdcda1-33e9-47ef-976f-c6a5ddab232a req-f77646fc-e448-470a-b3f2-6c6f7d23ceba service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Refreshing network info cache for port 9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:26:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:26:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23833353464343538', 'path': '/dev/sdh'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:26:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833353464343538', 'path': '/dev/sdh'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'flavor' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:26:44 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:26:44 user nova-compute[75100]:   <source dev="/dev/sdh"/>
Nov 13 17:26:44 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:26:44 user nova-compute[75100]:   <serial>60927720-11e9-46a8-9ce6-09ca1dff3396</serial>
Nov 13 17:26:44 user nova-compute[75100]: </disk>
Nov 13 17:26:44 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG nova.network.neutron [req-f5cdcda1-33e9-47ef-976f-c6a5ddab232a req-f77646fc-e448-470a-b3f2-6c6f7d23ceba service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Updated VIF entry in instance network info cache for port 9d6743f6-0376-4c4f-8b0a-67fabb52aa0d. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG nova.network.neutron [req-f5cdcda1-33e9-47ef-976f-c6a5ddab232a req-f77646fc-e448-470a-b3f2-6c6f7d23ceba service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Updating instance_info_cache with network_info: [{"id": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "address": "fa:16:3e:59:ae:36", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6743f6-03", "ovs_interfaceid": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f5cdcda1-33e9-47ef-976f-c6a5ddab232a req-f77646fc-e448-470a-b3f2-6c6f7d23ceba service nova] Releasing lock "refresh_cache-872216e9-0900-4427-949e-a6fadef5afc9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "872216e9-0900-4427-949e-a6fadef5afc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "872216e9-0900-4427-949e-a6fadef5afc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "872216e9-0900-4427-949e-a6fadef5afc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "872216e9-0900-4427-949e-a6fadef5afc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "872216e9-0900-4427-949e-a6fadef5afc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:44 user nova-compute[75100]: INFO nova.compute.manager [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Terminating instance
Nov 13 17:26:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No VIF found with MAC fa:16:3e:0b:72:c0, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0bc090dc-6ad1-4b89-ba02-dcd75461a760 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.347s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:45 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Instance destroyed successfully.
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.objects.instance [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lazy-loading 'resources' on Instance uuid 872216e9-0900-4427-949e-a6fadef5afc9 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1906344795',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1906344795',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1906344795',id=20,image_ref='9bfbd578-75ff-4c97-9d08-0b880a77a706',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALvZK6tNuys7myWuCpwz2LU+V+k90+nXGe2eF7f4BMLxTQhE1OCCr/FuyNUNbg6+W0quwQhhIntnH6yyUorddRY/ALF7V2MIUG8YthZANsWT1QhVOcq/EfBNBrj1jv2SA==',key_name='tempest-keypair-711334570',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:25:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-eyyesxfa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1156978750',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:25:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='421484d1f180498fa5e078c084d70986',uuid=872216e9-0900-4427-949e-a6fadef5afc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "address": "fa:16:3e:59:ae:36", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6743f6-03", "ovs_interfaceid": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "address": "fa:16:3e:59:ae:36", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d6743f6-03", "ovs_interfaceid": "9d6743f6-0376-4c4f-8b0a-67fabb52aa0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:ae:36,bridge_name='br-int',has_traffic_filtering=True,id=9d6743f6-0376-4c4f-8b0a-67fabb52aa0d,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6743f6-03') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_vif [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:ae:36,bridge_name='br-int',has_traffic_filtering=True,id=9d6743f6-0376-4c4f-8b0a-67fabb52aa0d,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6743f6-03') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d6743f6-03, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32b20769-090a-4723-85ce-f8c8d2ea7363) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:45 user nova-compute[75100]: INFO os_vif [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:ae:36,bridge_name='br-int',has_traffic_filtering=True,id=9d6743f6-0376-4c4f-8b0a-67fabb52aa0d,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d6743f6-03')
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WwCdoAaU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:26:45 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c371141-da8b-4db8-bdf3-0891206a096d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:26:45 user nova-compute[75100]: No targets found.
Nov 13 17:26:45 user nova-compute[75100]: iSNS:
Nov 13 17:26:45 user nova-compute[75100]: No targets found.
Nov 13 17:26:45 user nova-compute[75100]: STATIC:
Nov 13 17:26:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4
Nov 13 17:26:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:26:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:26:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:26:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:26:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:26:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6
Nov 13 17:26:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:26:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:26:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2
Nov 13 17:26:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:26:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:26:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e
Nov 13 17:26:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:26:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:26:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12
Nov 13 17:26:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:26:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:26:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396
Nov 13 17:26:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:26:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:26:45 user nova-compute[75100]: FIRMWARE:
Nov 13 17:26:45 user nova-compute[75100]: No targets found.
Nov 13 17:26:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:26:45 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:26:45 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89b802a-c296-4c77-9a7f-ab209ab2cfaf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7734e09-2356-4050-b6d2-ffb95fd17b73]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:26:45 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:26:45 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:26:45 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:26:45 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:26:45 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:26:45 user nova-compute[75100]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 (non-flash)
Nov 13 17:26:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:26:45 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:26:45 user nova-compute[75100]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 (non-flash)
Nov 13 17:26:45 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:26:45 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:26:45 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:26:45 user nova-compute[75100]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 (non-flash)
Nov 13 17:26:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c66e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e8d8c1-13fd-4dd5-b93b-6b02dd10aef0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1c2adc-70d9-4440-b743-4813825e308e]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c6ebfd-5487-4117-b71b-0bf2d7f1314b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2745daa-2d28-46d2-9306-24ae446d5568]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOfb07d6f8-3671482cd7d8d7fa', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fb07d6f8', '/dev/disk/by-id/scsi-23336373134383263') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57adf57-cee4-45df-948c-d3ad48deced4]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2030d3-78e2-4c6f-8fd4-19323fdbf9f7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce3a3aa-77af-49ea-8c1f-0c6eeda09ca7]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2, portal: 172.16.0.220,3260]
Nov 13 17:26:45 user nova-compute[75100]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2, portal: 172.16.0.220,3260] successful.
Nov 13 17:26:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143672fa-cd42-4ad2-a11d-639043f47af2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebfe43b-52bf-49e8-98b5-81d1720eb5f8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== disconnect_volume: return (392ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:26:45 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Deleting instance files /opt/stack/data/nova/instances/872216e9-0900-4427-949e-a6fadef5afc9_del
Nov 13 17:26:45 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Deletion of /opt/stack/data/nova/instances/872216e9-0900-4427-949e-a6fadef5afc9_del complete
Nov 13 17:26:45 user nova-compute[75100]: INFO nova.compute.manager [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-64008ef6-2ff6-46a9-9831-c2f5a21c0b1d req-80f885d2-3fea-4e80-b56f-2fa435ab1d85 service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Received event network-vif-unplugged-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64008ef6-2ff6-46a9-9831-c2f5a21c0b1d req-80f885d2-3fea-4e80-b56f-2fa435ab1d85 service nova] Acquiring lock "872216e9-0900-4427-949e-a6fadef5afc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64008ef6-2ff6-46a9-9831-c2f5a21c0b1d req-80f885d2-3fea-4e80-b56f-2fa435ab1d85 service nova] Lock "872216e9-0900-4427-949e-a6fadef5afc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64008ef6-2ff6-46a9-9831-c2f5a21c0b1d req-80f885d2-3fea-4e80-b56f-2fa435ab1d85 service nova] Lock "872216e9-0900-4427-949e-a6fadef5afc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-64008ef6-2ff6-46a9-9831-c2f5a21c0b1d req-80f885d2-3fea-4e80-b56f-2fa435ab1d85 service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] No waiting events found dispatching network-vif-unplugged-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-64008ef6-2ff6-46a9-9831-c2f5a21c0b1d req-80f885d2-3fea-4e80-b56f-2fa435ab1d85 service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Received event network-vif-unplugged-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-64008ef6-2ff6-46a9-9831-c2f5a21c0b1d req-80f885d2-3fea-4e80-b56f-2fa435ab1d85 service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Received event network-vif-plugged-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64008ef6-2ff6-46a9-9831-c2f5a21c0b1d req-80f885d2-3fea-4e80-b56f-2fa435ab1d85 service nova] Acquiring lock "872216e9-0900-4427-949e-a6fadef5afc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64008ef6-2ff6-46a9-9831-c2f5a21c0b1d req-80f885d2-3fea-4e80-b56f-2fa435ab1d85 service nova] Lock "872216e9-0900-4427-949e-a6fadef5afc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64008ef6-2ff6-46a9-9831-c2f5a21c0b1d req-80f885d2-3fea-4e80-b56f-2fa435ab1d85 service nova] Lock "872216e9-0900-4427-949e-a6fadef5afc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-64008ef6-2ff6-46a9-9831-c2f5a21c0b1d req-80f885d2-3fea-4e80-b56f-2fa435ab1d85 service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] No waiting events found dispatching network-vif-plugged-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:45 user nova-compute[75100]: WARNING nova.compute.manager [req-64008ef6-2ff6-46a9-9831-c2f5a21c0b1d req-80f885d2-3fea-4e80-b56f-2fa435ab1d85 service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Received unexpected event network-vif-plugged-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d for instance with vm_state active and task_state deleting.
Nov 13 17:26:46 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:26:46 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Took 0.78 seconds to deallocate network for instance.
Nov 13 17:26:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:47 user nova-compute[75100]: INFO nova.compute.manager [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Took 0.97 seconds to detach 1 volumes for instance.
Nov 13 17:26:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Deleting volume: 143672fa-cd42-4ad2-a11d-639043f47af2 {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 17:26:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-46787ce2-625a-439c-8812-9bef8cd48c51 req-19ddebb3-90dd-4b60-9e10-819dff642fb0 service nova] [instance: 872216e9-0900-4427-949e-a6fadef5afc9] Received event network-vif-deleted-9d6743f6-0376-4c4f-8b0a-67fabb52aa0d {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:48 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:26:48 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:26:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:48 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Deleted allocations for instance 872216e9-0900-4427-949e-a6fadef5afc9
Nov 13 17:26:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-03c85b01-9440-429b-b72c-a6969518cfe5 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "872216e9-0900-4427-949e-a6fadef5afc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.846s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:52 user nova-compute[75100]: INFO nova.compute.manager [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Detaching volume 60927720-11e9-46a8-9ce6-09ca1dff3396
Nov 13 17:26:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:52 user nova-compute[75100]: INFO nova.virt.block_device [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attempting to driver detach volume 60927720-11e9-46a8-9ce6-09ca1dff3396 from mountpoint /dev/vdb
Nov 13 17:26:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Attempting to detach device vdb from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:26:52 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:26:52 user nova-compute[75100]:   <source dev="/dev/sdh"/>
Nov 13 17:26:52 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:26:52 user nova-compute[75100]:   <serial>60927720-11e9-46a8-9ce6-09ca1dff3396</serial>
Nov 13 17:26:52 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:26:52 user nova-compute[75100]: </disk>
Nov 13 17:26:52 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:26:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Successfully detached device vdb from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the persistent domain config.
Nov 13 17:26:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:26:52 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:26:52 user nova-compute[75100]:   <source dev="/dev/sdh"/>
Nov 13 17:26:52 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:26:52 user nova-compute[75100]:   <serial>60927720-11e9-46a8-9ce6-09ca1dff3396</serial>
Nov 13 17:26:52 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:26:52 user nova-compute[75100]: </disk>
Nov 13 17:26:52 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:52 user nova-compute[75100]: INFO nova.compute.manager [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Terminating instance
Nov 13 17:26:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-86abde27-97e7-434a-b783-9c58b54a3af8 req-3da21728-2753-4f55-9443-737133e1a286 service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Received event network-vif-unplugged-cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86abde27-97e7-434a-b783-9c58b54a3af8 req-3da21728-2753-4f55-9443-737133e1a286 service nova] Acquiring lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86abde27-97e7-434a-b783-9c58b54a3af8 req-3da21728-2753-4f55-9443-737133e1a286 service nova] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86abde27-97e7-434a-b783-9c58b54a3af8 req-3da21728-2753-4f55-9443-737133e1a286 service nova] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-86abde27-97e7-434a-b783-9c58b54a3af8 req-3da21728-2753-4f55-9443-737133e1a286 service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] No waiting events found dispatching network-vif-unplugged-cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-86abde27-97e7-434a-b783-9c58b54a3af8 req-3da21728-2753-4f55-9443-737133e1a286 service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Received event network-vif-unplugged-cb8dca61-0235-46fe-a218-b79fd647ca06 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:26:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Instance destroyed successfully.
Nov 13 17:26:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lazy-loading 'resources' on Instance uuid 1377f31d-9021-4cc1-9f36-c363d0a8bfda {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:25:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1171367672',display_name='tempest-VolumesActionsTest-instance-1171367672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1171367672',id=21,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:25:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ee9b168baa5460188724804ab3e0c46',ramdisk_id='',reservation_id='r-fnf0gpka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1834502567',owner_user_name='tempest-VolumesActionsTest-1834502567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:25:10Z,user_data=None,user_id='6fd81f3463fe4d81829faabc18c938f8',uuid=1377f31d-9021-4cc1-9f36-c363d0a8bfda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb8dca61-0235-46fe-a218-b79fd647ca06", "address": "fa:16:3e:9b:ca:22", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8dca61-02", "ovs_interfaceid": "cb8dca61-0235-46fe-a218-b79fd647ca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:26:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Converting VIF {"id": "cb8dca61-0235-46fe-a218-b79fd647ca06", "address": "fa:16:3e:9b:ca:22", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb8dca61-02", "ovs_interfaceid": "cb8dca61-0235-46fe-a218-b79fd647ca06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ca:22,bridge_name='br-int',has_traffic_filtering=True,id=cb8dca61-0235-46fe-a218-b79fd647ca06,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8dca61-02') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG os_vif [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ca:22,bridge_name='br-int',has_traffic_filtering=True,id=cb8dca61-0235-46fe-a218-b79fd647ca06,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8dca61-02') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb8dca61-02, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=272eae87-c556-4461-acef-77244ba50de2) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:53 user nova-compute[75100]: INFO os_vif [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:ca:22,bridge_name='br-int',has_traffic_filtering=True,id=cb8dca61-0235-46fe-a218-b79fd647ca06,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb8dca61-02')
Nov 13 17:26:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Deleting instance files /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda_del
Nov 13 17:26:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Deletion of /opt/stack/data/nova/instances/1377f31d-9021-4cc1-9f36-c363d0a8bfda_del complete
Nov 13 17:26:53 user nova-compute[75100]: INFO nova.compute.manager [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 13 17:26:53 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:26:53 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Took 0.77 seconds to deallocate network for instance.
Nov 13 17:26:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-6ccebf7c-5795-47cc-b8d0-b7a49a8250f3 req-2d8f3a9a-bcc4-4185-b11d-c8ca6ec1f7ce service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Received event network-vif-deleted-cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:54 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:26:54 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:26:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:54 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Deleted allocations for instance 1377f31d-9021-4cc1-9f36-c363d0a8bfda
Nov 13 17:26:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5f80060b-2a1e-4002-8b60-befad443bd98 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-f2af408d-51f9-43d4-b0cb-163f6cde2662 req-d479145f-42b0-4058-a932-64ff360cca8a service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Received event network-vif-plugged-cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:26:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f2af408d-51f9-43d4-b0cb-163f6cde2662 req-d479145f-42b0-4058-a932-64ff360cca8a service nova] Acquiring lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:26:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f2af408d-51f9-43d4-b0cb-163f6cde2662 req-d479145f-42b0-4058-a932-64ff360cca8a service nova] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:26:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f2af408d-51f9-43d4-b0cb-163f6cde2662 req-d479145f-42b0-4058-a932-64ff360cca8a service nova] Lock "1377f31d-9021-4cc1-9f36-c363d0a8bfda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:26:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-f2af408d-51f9-43d4-b0cb-163f6cde2662 req-d479145f-42b0-4058-a932-64ff360cca8a service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] No waiting events found dispatching network-vif-plugged-cb8dca61-0235-46fe-a218-b79fd647ca06 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:26:54 user nova-compute[75100]: WARNING nova.compute.manager [req-f2af408d-51f9-43d4-b0cb-163f6cde2662 req-d479145f-42b0-4058-a932-64ff360cca8a service nova] [instance: 1377f31d-9021-4cc1-9f36-c363d0a8bfda] Received unexpected event network-vif-plugged-cb8dca61-0235-46fe-a218-b79fd647ca06 for instance with vm_state deleted and task_state None.
Nov 13 17:26:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:26:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:12 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a is timed out.
Nov 13 17:27:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Successfully detached device vdb from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the live domain config.
Nov 13 17:27:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LtgJaQOI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:27:12 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[728ca4af-5798-4a6f-a7dc-349543b7aae9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:27:12 user nova-compute[75100]: No targets found.
Nov 13 17:27:12 user nova-compute[75100]: iSNS:
Nov 13 17:27:12 user nova-compute[75100]: No targets found.
Nov 13 17:27:12 user nova-compute[75100]: STATIC:
Nov 13 17:27:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4
Nov 13 17:27:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:27:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:27:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:27:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:27:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:27:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6
Nov 13 17:27:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:27:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:27:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e
Nov 13 17:27:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:27:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:27:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12
Nov 13 17:27:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:27:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:27:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396
Nov 13 17:27:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:27:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:27:12 user nova-compute[75100]: FIRMWARE:
Nov 13 17:27:12 user nova-compute[75100]: No targets found.
Nov 13 17:27:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:27:12 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:27:12 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[951a408c-e481-4398-8bd5-dd5e8337238a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb18153-9305-4ba8-8616-eeae575237fa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:27:12 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:27:12 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:27:12 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:27:12 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:27:12 user nova-compute[75100]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 (non-flash)
Nov 13 17:27:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:27:12 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:27:12 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:27:12 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:27:12 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:27:12 user nova-compute[75100]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 (non-flash)
Nov 13 17:27:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38d428c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396'): ({'sdh'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Removing single pathed devices sdh {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d266b4e4-0a9a-4bee-a0d3-61066c9f78fa]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fe1b8d-cce9-4f86-bccd-7b93b6569211]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Flushing IO for device /dev/sdh {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f6fc42-d8d2-47cd-ad54-7979df4b7a9e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2549de32-4620-4b3a-a098-84c397394c34]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] SCSI volumes sdh have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ad16c5-8229-42b5-b094-40f79e8f5797]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e064d6-7573-48ca-a183-f5f450d4da53]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396, portal: 172.16.0.220,3260]
Nov 13 17:27:12 user nova-compute[75100]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396, portal: 172.16.0.220,3260] successful.
Nov 13 17:27:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60927720-11e9-46a8-9ce6-09ca1dff3396 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bc0235-4605-4687-8f35-4f47668b8708]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] <== disconnect_volume: return (327ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:27:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:27:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:27:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'flavor' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:27:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e135fbca-486c-4c85-81dc-2e9e57e3cfe0 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.663s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:27:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:27:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:27:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:21 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:27:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:27:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:27:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:27:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:27:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:27:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7552MB free_disk=25.229934692382812GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance eec9ecbd-569c-46ec-9e74-3160c9ccd39f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 5933add2-b8bb-448d-a054-d8527e3c49f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 64c9f78b-8ce5-4328-9fb0-93715df6135f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance e96eb705-85e2-4cce-a91d-5d319b1b5083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d2c4575b-ef8d-4a9d-9650-459366b7227e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d4f158c3-bcd5-4d5b-8c70-04726b17081a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:27:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:27:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:27:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:27:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:27:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:27:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:27:27 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:27:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Updating instance_info_cache with network_info: [{"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:27:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:27:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:27:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:27:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:27:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:27:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:27:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:27:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:27:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:27:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:36 user nova-compute[75100]: INFO nova.compute.manager [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Terminating instance
Nov 13 17:27:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-d1541726-2f14-4029-b8f5-c25c1286b2bb req-43dd60f0-94e1-482b-af99-97ddf506da58 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Received event network-vif-unplugged-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d1541726-2f14-4029-b8f5-c25c1286b2bb req-43dd60f0-94e1-482b-af99-97ddf506da58 service nova] Acquiring lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d1541726-2f14-4029-b8f5-c25c1286b2bb req-43dd60f0-94e1-482b-af99-97ddf506da58 service nova] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d1541726-2f14-4029-b8f5-c25c1286b2bb req-43dd60f0-94e1-482b-af99-97ddf506da58 service nova] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-d1541726-2f14-4029-b8f5-c25c1286b2bb req-43dd60f0-94e1-482b-af99-97ddf506da58 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] No waiting events found dispatching network-vif-unplugged-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-d1541726-2f14-4029-b8f5-c25c1286b2bb req-43dd60f0-94e1-482b-af99-97ddf506da58 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Received event network-vif-unplugged-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Instance destroyed successfully.
Nov 13 17:27:36 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lazy-loading 'resources' on Instance uuid eec9ecbd-569c-46ec-9e74-3160c9ccd39f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:22:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-882964996',display_name='tempest-TestVolumeBootPattern-volume-backed-server-882964996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-882964996',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL3nrIQ1ZwEhcXdMKF1A8Fq1zeWahekSwObEL3bvrgNYjzAkS7w9Jo90A8RfjPZMzzaLjtVTn+nkIFee9arV4rZjAFQJoJPJh/CuBCErsgSzgUJDqn5UoMYHiYyOo7b4JQ==',key_name='tempest-keypair-2107698519',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:23:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-abulzej2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:23:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='421484d1f180498fa5e078c084d70986',uuid=eec9ecbd-569c-46ec-9e74-3160c9ccd39f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "address": "fa:16:3e:9c:81:1e", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb620c-cd", "ovs_interfaceid": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "address": "fa:16:3e:9c:81:1e", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb620c-cd", "ovs_interfaceid": "f8cb620c-cdc4-4191-ae25-c29a6eb099b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:81:1e,bridge_name='br-int',has_traffic_filtering=True,id=f8cb620c-cdc4-4191-ae25-c29a6eb099b0,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb620c-cd') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG os_vif [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:81:1e,bridge_name='br-int',has_traffic_filtering=True,id=f8cb620c-cdc4-4191-ae25-c29a6eb099b0,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb620c-cd') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8cb620c-cd, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7a04f13-6b32-493f-82d1-4123feddf5a7) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:36 user nova-compute[75100]: INFO os_vif [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:81:1e,bridge_name='br-int',has_traffic_filtering=True,id=f8cb620c-cdc4-4191-ae25-c29a6eb099b0,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb620c-cd')
Nov 13 17:27:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QslwgxEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:27:36 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:27:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cacaac-a17d-4710-9311-7ac7333f988a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:27:36 user nova-compute[75100]: No targets found.
Nov 13 17:27:36 user nova-compute[75100]: iSNS:
Nov 13 17:27:36 user nova-compute[75100]: No targets found.
Nov 13 17:27:36 user nova-compute[75100]: STATIC:
Nov 13 17:27:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4
Nov 13 17:27:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:27:36 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:27:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:27:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:27:36 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:27:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6
Nov 13 17:27:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:27:36 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:27:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e
Nov 13 17:27:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:27:36 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:27:36 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12
Nov 13 17:27:36 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:27:36 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:27:36 user nova-compute[75100]: FIRMWARE:
Nov 13 17:27:36 user nova-compute[75100]: No targets found.
Nov 13 17:27:36 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:27:36 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:27:36 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:27:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[655ac6ff-cf32-4695-b4ec-4aba24fda8eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[172b946b-e859-4c3f-951a-465daec27a14]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:27:37 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:27:37 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:27:37 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:27:37 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:27:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:27:37 user nova-compute[75100]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 (non-flash)
Nov 13 17:27:37 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:27:37 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:27:37 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:27:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38d1c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ce41c-709b-45eb-9793-87257399a4ec]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3ee9e-d28f-4142-8358-1727ee623720]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eebb2f-5d6c-4170-9a0d-54d951bcef37]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f15bd3f-b474-4a6f-9756-df3c83d15405]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23561623366376636', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_93963fd1', '/dev/disk/by-id/scsi-1SCST_BIO93963fd1-5ab3f7f647eb674e') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c642870e-6bf0-4d74-8e65-a055f759177a]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c2d3b1-dc79-4afe-b7c2-4bfe42d85e5f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[96027992-3e8f-4691-91d3-6771938de220]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6, portal: 172.16.0.220,3260]
Nov 13 17:27:37 user nova-compute[75100]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6, portal: 172.16.0.220,3260] successful.
Nov 13 17:27:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2756f150-81ce-420c-9670-d02f76690ef6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[08388679-ebc8-475d-ae0e-bd3025facbc9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== disconnect_volume: return (306ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:27:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Deleting instance files /opt/stack/data/nova/instances/eec9ecbd-569c-46ec-9e74-3160c9ccd39f_del
Nov 13 17:27:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Deletion of /opt/stack/data/nova/instances/eec9ecbd-569c-46ec-9e74-3160c9ccd39f_del complete
Nov 13 17:27:37 user nova-compute[75100]: INFO nova.compute.manager [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 13 17:27:37 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:27:37 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Took 0.62 seconds to deallocate network for instance.
Nov 13 17:27:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-4df66f7a-1d20-4ab0-8576-39fae14345bf req-3ee45dcd-62b3-4d4e-8627-f9383ffee0cc service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Received event network-vif-deleted-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:27:37 user nova-compute[75100]: INFO nova.compute.manager [req-4df66f7a-1d20-4ab0-8576-39fae14345bf req-3ee45dcd-62b3-4d4e-8627-f9383ffee0cc service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Neutron deleted interface f8cb620c-cdc4-4191-ae25-c29a6eb099b0; detaching it from the instance and deleting it from the info cache
Nov 13 17:27:37 user nova-compute[75100]: DEBUG nova.network.neutron [req-4df66f7a-1d20-4ab0-8576-39fae14345bf req-3ee45dcd-62b3-4d4e-8627-f9383ffee0cc service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:27:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-4df66f7a-1d20-4ab0-8576-39fae14345bf req-3ee45dcd-62b3-4d4e-8627-f9383ffee0cc service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Detach interface failed, port_id=f8cb620c-cdc4-4191-ae25-c29a6eb099b0, reason: Instance eec9ecbd-569c-46ec-9e74-3160c9ccd39f could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:27:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-37293c2e-2a56-4f5f-9c71-bd5fb52b1add req-cb007073-6baa-4616-bcef-a3993e769cf8 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Received event network-vif-plugged-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:27:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-37293c2e-2a56-4f5f-9c71-bd5fb52b1add req-cb007073-6baa-4616-bcef-a3993e769cf8 service nova] Acquiring lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-37293c2e-2a56-4f5f-9c71-bd5fb52b1add req-cb007073-6baa-4616-bcef-a3993e769cf8 service nova] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-37293c2e-2a56-4f5f-9c71-bd5fb52b1add req-cb007073-6baa-4616-bcef-a3993e769cf8 service nova] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-37293c2e-2a56-4f5f-9c71-bd5fb52b1add req-cb007073-6baa-4616-bcef-a3993e769cf8 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] No waiting events found dispatching network-vif-plugged-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:27:38 user nova-compute[75100]: WARNING nova.compute.manager [req-37293c2e-2a56-4f5f-9c71-bd5fb52b1add req-cb007073-6baa-4616-bcef-a3993e769cf8 service nova] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Received unexpected event network-vif-plugged-f8cb620c-cdc4-4191-ae25-c29a6eb099b0 for instance with vm_state active and task_state deleting.
Nov 13 17:27:38 user nova-compute[75100]: INFO nova.compute.manager [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Took 0.70 seconds to detach 1 volumes for instance.
Nov 13 17:27:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: eec9ecbd-569c-46ec-9e74-3160c9ccd39f] Deleting volume: 2756f150-81ce-420c-9670-d02f76690ef6 {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 17:27:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:39 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:27:39 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:39 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Deleted allocations for instance eec9ecbd-569c-46ec-9e74-3160c9ccd39f
Nov 13 17:27:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebd5dc39-0ebb-4687-bbad-ccbf897e8888 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "eec9ecbd-569c-46ec-9e74-3160c9ccd39f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.158s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:27:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:43 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:27:43 user nova-compute[75100]: INFO nova.compute.claims [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Claim successful on node user
Nov 13 17:27:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:43 user nova-compute[75100]: DEBUG nova.objects.instance [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'flavor' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:44 user nova-compute[75100]: INFO nova.compute.manager [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attaching volume 6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 to /dev/vdb
Nov 13 17:27:44 user nova-compute[75100]: DEBUG os_brick.utils [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bd921a-d57d-4aa8-b198-bdc0fffd2da2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[de396f55-82c8-40c9-bbdd-5ccc1a2fe77e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb6524d-f239-41d8-9f43-28221ddcadb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a87327-0298-4b6d-b6cc-e740692d17df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:27:44 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8848d5f-7896-458d-ba3a-1b3790c941ad]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG nova.network.neutron [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG os_brick.utils [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Updating existing volume attachment record: 2c21ffd6-053a-4aa3-aa50-dbaa1dea3586 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:27:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:27:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG nova.policy [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fd81f3463fe4d81829faabc18c938f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ee9b168baa5460188724804ab3e0c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:27:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Creating image(s)
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "/opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "/opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "/opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.168s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk 1073741824" returned: 0 in 0.055s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Successfully created port: bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Cannot resize image /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Ensure instance console log exists: /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Successfully updated port: bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "refresh_cache-a10bd002-4f94-4907-994e-7b9f2da6ca3a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquired lock "refresh_cache-a10bd002-4f94-4907-994e-7b9f2da6ca3a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-3f657428-3507-4b32-bbb3-3adbacd8d886 req-929789a3-3cce-46f6-b3e2-485bd4aa6583 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Received event network-changed-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-3f657428-3507-4b32-bbb3-3adbacd8d886 req-929789a3-3cce-46f6-b3e2-485bd4aa6583 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Refreshing instance network info cache due to event network-changed-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3f657428-3507-4b32-bbb3-3adbacd8d886 req-929789a3-3cce-46f6-b3e2-485bd4aa6583 service nova] Acquiring lock "refresh_cache-a10bd002-4f94-4907-994e-7b9f2da6ca3a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Updating instance_info_cache with network_info: [{"id": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "address": "fa:16:3e:86:c3:ca", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc53d9b5-9f", "ovs_interfaceid": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Releasing lock "refresh_cache-a10bd002-4f94-4907-994e-7b9f2da6ca3a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Instance network_info: |[{"id": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "address": "fa:16:3e:86:c3:ca", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc53d9b5-9f", "ovs_interfaceid": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3f657428-3507-4b32-bbb3-3adbacd8d886 req-929789a3-3cce-46f6-b3e2-485bd4aa6583 service nova] Acquired lock "refresh_cache-a10bd002-4f94-4907-994e-7b9f2da6ca3a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.network.neutron [req-3f657428-3507-4b32-bbb3-3adbacd8d886 req-929789a3-3cce-46f6-b3e2-485bd4aa6583 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Refreshing network info cache for port bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Start _get_guest_xml network_info=[{"id": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "address": "fa:16:3e:86:c3:ca", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc53d9b5-9f", "ovs_interfaceid": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:27:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:27:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:27:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2124080179',display_name='tempest-VolumesActionsTest-instance-2124080179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2124080179',id=23,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ee9b168baa5460188724804ab3e0c46',ramdisk_id='',reservation_id='r-x9nep5q7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1834502567',owner_user_name='tempest-VolumesActionsTest-1834502567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:27:44Z,user_data=None,user_id='6fd81f3463fe4d81829faabc18c938f8',uuid=a10bd002-4f94-4907-994e-7b9f2da6ca3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "address": "fa:16:3e:86:c3:ca", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc53d9b5-9f", "ovs_interfaceid": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Converting VIF {"id": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "address": "fa:16:3e:86:c3:ca", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc53d9b5-9f", "ovs_interfaceid": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c3:ca,bridge_name='br-int',has_traffic_filtering=True,id=bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc53d9b5-9f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lazy-loading 'pci_devices' on Instance uuid a10bd002-4f94-4907-994e-7b9f2da6ca3a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:27:46 user nova-compute[75100]:   <uuid>a10bd002-4f94-4907-994e-7b9f2da6ca3a</uuid>
Nov 13 17:27:46 user nova-compute[75100]:   <name>instance-00000017</name>
Nov 13 17:27:46 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:27:46 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:27:46 user nova-compute[75100]:   <metadata>
Nov 13 17:27:46 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:27:46 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:27:46 user nova-compute[75100]:       <nova:name>tempest-VolumesActionsTest-instance-2124080179</nova:name>
Nov 13 17:27:46 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:27:45</nova:creationTime>
Nov 13 17:27:46 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:27:46 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:27:46 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:27:46 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:27:46 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:27:46 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:27:46 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:27:46 user nova-compute[75100]:       <nova:owner>
Nov 13 17:27:46 user nova-compute[75100]:         <nova:user uuid="6fd81f3463fe4d81829faabc18c938f8">tempest-VolumesActionsTest-1834502567-project-member</nova:user>
Nov 13 17:27:46 user nova-compute[75100]:         <nova:project uuid="9ee9b168baa5460188724804ab3e0c46">tempest-VolumesActionsTest-1834502567</nova:project>
Nov 13 17:27:46 user nova-compute[75100]:       </nova:owner>
Nov 13 17:27:46 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:27:46 user nova-compute[75100]:       <nova:ports>
Nov 13 17:27:46 user nova-compute[75100]:         <nova:port uuid="bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1">
Nov 13 17:27:46 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 17:27:46 user nova-compute[75100]:         </nova:port>
Nov 13 17:27:46 user nova-compute[75100]:       </nova:ports>
Nov 13 17:27:46 user nova-compute[75100]:     </nova:instance>
Nov 13 17:27:46 user nova-compute[75100]:   </metadata>
Nov 13 17:27:46 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:27:46 user nova-compute[75100]:     <system>
Nov 13 17:27:46 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:27:46 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:27:46 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:27:46 user nova-compute[75100]:       <entry name="serial">a10bd002-4f94-4907-994e-7b9f2da6ca3a</entry>
Nov 13 17:27:46 user nova-compute[75100]:       <entry name="uuid">a10bd002-4f94-4907-994e-7b9f2da6ca3a</entry>
Nov 13 17:27:46 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:27:46 user nova-compute[75100]:     </system>
Nov 13 17:27:46 user nova-compute[75100]:   </sysinfo>
Nov 13 17:27:46 user nova-compute[75100]:   <os>
Nov 13 17:27:46 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:27:46 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:27:46 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:27:46 user nova-compute[75100]:   </os>
Nov 13 17:27:46 user nova-compute[75100]:   <features>
Nov 13 17:27:46 user nova-compute[75100]:     <acpi/>
Nov 13 17:27:46 user nova-compute[75100]:     <apic/>
Nov 13 17:27:46 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:27:46 user nova-compute[75100]:   </features>
Nov 13 17:27:46 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:27:46 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:27:46 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:27:46 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:27:46 user nova-compute[75100]:   </clock>
Nov 13 17:27:46 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:27:46 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:27:46 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:27:46 user nova-compute[75100]:   </cpu>
Nov 13 17:27:46 user nova-compute[75100]:   <devices>
Nov 13 17:27:46 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:27:46 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:27:46 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk"/>
Nov 13 17:27:46 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:27:46 user nova-compute[75100]:     </disk>
Nov 13 17:27:46 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:27:46 user nova-compute[75100]:       <mac address="fa:16:3e:86:c3:ca"/>
Nov 13 17:27:46 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:27:46 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:27:46 user nova-compute[75100]:       <target dev="tapbc53d9b5-9f"/>
Nov 13 17:27:46 user nova-compute[75100]:     </interface>
Nov 13 17:27:46 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:27:46 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/console.log" append="off"/>
Nov 13 17:27:46 user nova-compute[75100]:     </serial>
Nov 13 17:27:46 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:27:46 user nova-compute[75100]:     <video>
Nov 13 17:27:46 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:27:46 user nova-compute[75100]:     </video>
Nov 13 17:27:46 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:27:46 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:27:46 user nova-compute[75100]:     </rng>
Nov 13 17:27:46 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:27:46 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:27:46 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:27:46 user nova-compute[75100]:     </memballoon>
Nov 13 17:27:46 user nova-compute[75100]:   </devices>
Nov 13 17:27:46 user nova-compute[75100]: </domain>
Nov 13 17:27:46 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2124080179',display_name='tempest-VolumesActionsTest-instance-2124080179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2124080179',id=23,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ee9b168baa5460188724804ab3e0c46',ramdisk_id='',reservation_id='r-x9nep5q7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1834502567',owner_user_name='tempest-VolumesActionsTest-1834502567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:27:44Z,user_data=None,user_id='6fd81f3463fe4d81829faabc18c938f8',uuid=a10bd002-4f94-4907-994e-7b9f2da6ca3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "address": "fa:16:3e:86:c3:ca", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc53d9b5-9f", "ovs_interfaceid": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Converting VIF {"id": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "address": "fa:16:3e:86:c3:ca", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc53d9b5-9f", "ovs_interfaceid": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c3:ca,bridge_name='br-int',has_traffic_filtering=True,id=bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc53d9b5-9f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG os_vif [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c3:ca,bridge_name='br-int',has_traffic_filtering=True,id=bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc53d9b5-9f') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aefe5926-6820-5826-a935-294af6efe04e', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc53d9b5-9f, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc53d9b5-9f, col_values=(('qos', UUID('0bd78ec4-f048-4685-bbf8-f4cf2ec2b2d3')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc53d9b5-9f, col_values=(('external_ids', {'iface-id': 'bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:c3:ca', 'vm-uuid': 'a10bd002-4f94-4907-994e-7b9f2da6ca3a'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:46 user nova-compute[75100]: INFO os_vif [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c3:ca,bridge_name='br-int',has_traffic_filtering=True,id=bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc53d9b5-9f')
Nov 13 17:27:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] No VIF found with MAC fa:16:3e:86:c3:ca, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-3f657428-3507-4b32-bbb3-3adbacd8d886 req-929789a3-3cce-46f6-b3e2-485bd4aa6583 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Updated VIF entry in instance network info cache for port bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-3f657428-3507-4b32-bbb3-3adbacd8d886 req-929789a3-3cce-46f6-b3e2-485bd4aa6583 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Updating instance_info_cache with network_info: [{"id": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "address": "fa:16:3e:86:c3:ca", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc53d9b5-9f", "ovs_interfaceid": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:27:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3f657428-3507-4b32-bbb3-3adbacd8d886 req-929789a3-3cce-46f6-b3e2-485bd4aa6583 service nova] Releasing lock "refresh_cache-a10bd002-4f94-4907-994e-7b9f2da6ca3a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:27:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-c1ce6067-4926-4aea-8df4-0516829be1f6 req-2ed6302b-102b-4722-bd5c-fe6b8d136445 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Received event network-vif-plugged-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:27:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c1ce6067-4926-4aea-8df4-0516829be1f6 req-2ed6302b-102b-4722-bd5c-fe6b8d136445 service nova] Acquiring lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c1ce6067-4926-4aea-8df4-0516829be1f6 req-2ed6302b-102b-4722-bd5c-fe6b8d136445 service nova] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c1ce6067-4926-4aea-8df4-0516829be1f6 req-2ed6302b-102b-4722-bd5c-fe6b8d136445 service nova] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-c1ce6067-4926-4aea-8df4-0516829be1f6 req-2ed6302b-102b-4722-bd5c-fe6b8d136445 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] No waiting events found dispatching network-vif-plugged-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:27:47 user nova-compute[75100]: WARNING nova.compute.manager [req-c1ce6067-4926-4aea-8df4-0516829be1f6 req-2ed6302b-102b-4722-bd5c-fe6b8d136445 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Received unexpected event network-vif-plugged-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 for instance with vm_state building and task_state spawning.
Nov 13 17:27:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFGORIcw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:27:48 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:27:48 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:27:48 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4c5f07-bc82-4fb0-bda5-2f7ceab3643d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:27:48 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1608f9f4-90c0-4d2f-a750-3f5315ac971f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28] added
Nov 13 17:27:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2704294e-2c2a-45dc-a8fc-ed68331fb63b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cac853-ce28-44bf-ab95-29b3ad3f167a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFGORIcw {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFGORIcw" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce707e0-e587-4054-918f-3939315a5fc5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yFGORIcw'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38d1e03-02c3-483a-b5f7-70b37799a6c5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b98493-a104-4b66-9f60-3b830f044617]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e04e61-129f-4d1d-9ec7-6dcc627db762]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28, portal: 172.16.0.220,3260]
Nov 13 17:27:48 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28, portal: 172.16.0.220,3260] successful.
Nov 13 17:27:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[552c5b21-3883-4b87-b366-fff25c147136]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[438e65bc-af20-46e2-b7bd-35e7b8d806e0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)
Nov 13 17:27:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d01936-8161-43ec-979b-49bb0da6cd29]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:27:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFGORIcw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:27:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Instance spawned successfully.
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:27:49 user nova-compute[75100]: INFO nova.compute.manager [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-a343b8fe-ca36-4d73-a777-bd87e7d533d9 req-c76bb9a3-efd5-4894-bc39-06dcb16c1031 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Received event network-vif-plugged-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a343b8fe-ca36-4d73-a777-bd87e7d533d9 req-c76bb9a3-efd5-4894-bc39-06dcb16c1031 service nova] Acquiring lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a343b8fe-ca36-4d73-a777-bd87e7d533d9 req-c76bb9a3-efd5-4894-bc39-06dcb16c1031 service nova] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a343b8fe-ca36-4d73-a777-bd87e7d533d9 req-c76bb9a3-efd5-4894-bc39-06dcb16c1031 service nova] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-a343b8fe-ca36-4d73-a777-bd87e7d533d9 req-c76bb9a3-efd5-4894-bc39-06dcb16c1031 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] No waiting events found dispatching network-vif-plugged-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:27:49 user nova-compute[75100]: WARNING nova.compute.manager [req-a343b8fe-ca36-4d73-a777-bd87e7d533d9 req-c76bb9a3-efd5-4894-bc39-06dcb16c1031 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Received unexpected event network-vif-plugged-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 for instance with vm_state building and task_state spawning.
Nov 13 17:27:49 user nova-compute[75100]: INFO nova.compute.manager [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Took 6.08 seconds to build instance.
Nov 13 17:27:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23736333538643538', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736333538643538', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-959bbab4-cde1-48a6-9173-9a7001ff1d3f tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.181s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.objects.instance [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'flavor' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:27:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:27:49 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:27:49 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:27:49 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:27:49 user nova-compute[75100]:   <serial>6b4a93f1-47ee-492a-ad10-16bdc0fa1d28</serial>
Nov 13 17:27:49 user nova-compute[75100]: </disk>
Nov 13 17:27:49 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:27:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:27:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:27:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No VIF found with MAC fa:16:3e:0b:72:c0, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:27:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-665d092f-7010-4953-9431-3c1447c7bd62 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.316s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:52 user nova-compute[75100]: INFO nova.compute.manager [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Detaching volume 6b4a93f1-47ee-492a-ad10-16bdc0fa1d28
Nov 13 17:27:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:52 user nova-compute[75100]: INFO nova.virt.block_device [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attempting to driver detach volume 6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 from mountpoint /dev/vdb
Nov 13 17:27:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Attempting to detach device vdb from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:27:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:27:52 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:27:52 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:27:52 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:27:52 user nova-compute[75100]:   <serial>6b4a93f1-47ee-492a-ad10-16bdc0fa1d28</serial>
Nov 13 17:27:52 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:27:52 user nova-compute[75100]: </disk>
Nov 13 17:27:52 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:27:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Successfully detached device vdb from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the persistent domain config.
Nov 13 17:27:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:27:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:27:52 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:27:52 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:27:52 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:27:52 user nova-compute[75100]:   <serial>6b4a93f1-47ee-492a-ad10-16bdc0fa1d28</serial>
Nov 13 17:27:52 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:27:52 user nova-compute[75100]: </disk>
Nov 13 17:27:52 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:27:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:27:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:27:53 user nova-compute[75100]: INFO nova.compute.claims [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Claim successful on node user
Nov 13 17:27:53 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:27:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:27:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG nova.policy [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33657093c7ab4112994a1b7e997cfb34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c1d1cfd844465e85239be73eb73cec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:27:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Creating image(s)
Nov 13 17:27:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "/opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "/opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "/opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk 1073741824" returned: 0 in 0.063s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Successfully created port: 46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Cannot resize image /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Ensure instance console log exists: /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Successfully updated port: 46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquired lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-79d34d43-8371-4a55-85b8-31d784a62342 req-f6a221a8-d930-4f0f-9e97-6d995e2ca0e7 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-changed-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-79d34d43-8371-4a55-85b8-31d784a62342 req-f6a221a8-d930-4f0f-9e97-6d995e2ca0e7 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Refreshing instance network info cache due to event network-changed-46c2fa4e-5fb5-4798-b9b0-dcf9536addac. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-79d34d43-8371-4a55-85b8-31d784a62342 req-f6a221a8-d930-4f0f-9e97-6d995e2ca0e7 service nova] Acquiring lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:27:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updating instance_info_cache with network_info: [{"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Releasing lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Instance network_info: |[{"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-79d34d43-8371-4a55-85b8-31d784a62342 req-f6a221a8-d930-4f0f-9e97-6d995e2ca0e7 service nova] Acquired lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-79d34d43-8371-4a55-85b8-31d784a62342 req-f6a221a8-d930-4f0f-9e97-6d995e2ca0e7 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Refreshing network info cache for port 46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Start _get_guest_xml network_info=[{"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:27:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:27:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:27:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1020004757',display_name='tempest-ServerRescueNegativeTestJSON-server-1020004757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1020004757',id=24,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG40rnWNdDGw6MfW9fJQy1Qo+Xea5DaDsFvBwt2VMxDpCa3aXwJVnMHiiqQw5ZYsyNK2tVKIhgW2j1pldZydkRtj1dqFcGsv+wEELqc/1VWu3BcXOz51BEeAHnpPKQUIAg==',key_name='tempest-keypair-607988464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6c1d1cfd844465e85239be73eb73cec',ramdisk_id='',reservation_id='r-o69if3j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1273984533',owner_user_name='tempest-ServerRescueNegativeTestJSON-1273984533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33657093c7ab4112994a1b7e997cfb34',uuid=d30816f4-82ec-43b9-bd47-f34190e5c82f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converting VIF {"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=46c2fa4e-5fb5-4798-b9b0-dcf9536addac,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c2fa4e-5f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'pci_devices' on Instance uuid d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:27:55 user nova-compute[75100]:   <uuid>d30816f4-82ec-43b9-bd47-f34190e5c82f</uuid>
Nov 13 17:27:55 user nova-compute[75100]:   <name>instance-00000018</name>
Nov 13 17:27:55 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:27:55 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:27:55 user nova-compute[75100]:   <metadata>
Nov 13 17:27:55 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:27:55 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:27:55 user nova-compute[75100]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1020004757</nova:name>
Nov 13 17:27:55 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:27:55</nova:creationTime>
Nov 13 17:27:55 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:27:55 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:27:55 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:27:55 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:27:55 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:27:55 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:27:55 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:27:55 user nova-compute[75100]:       <nova:owner>
Nov 13 17:27:55 user nova-compute[75100]:         <nova:user uuid="33657093c7ab4112994a1b7e997cfb34">tempest-ServerRescueNegativeTestJSON-1273984533-project-member</nova:user>
Nov 13 17:27:55 user nova-compute[75100]:         <nova:project uuid="d6c1d1cfd844465e85239be73eb73cec">tempest-ServerRescueNegativeTestJSON-1273984533</nova:project>
Nov 13 17:27:55 user nova-compute[75100]:       </nova:owner>
Nov 13 17:27:55 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:27:55 user nova-compute[75100]:       <nova:ports>
Nov 13 17:27:55 user nova-compute[75100]:         <nova:port uuid="46c2fa4e-5fb5-4798-b9b0-dcf9536addac">
Nov 13 17:27:55 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 17:27:55 user nova-compute[75100]:         </nova:port>
Nov 13 17:27:55 user nova-compute[75100]:       </nova:ports>
Nov 13 17:27:55 user nova-compute[75100]:     </nova:instance>
Nov 13 17:27:55 user nova-compute[75100]:   </metadata>
Nov 13 17:27:55 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:27:55 user nova-compute[75100]:     <system>
Nov 13 17:27:55 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:27:55 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:27:55 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:27:55 user nova-compute[75100]:       <entry name="serial">d30816f4-82ec-43b9-bd47-f34190e5c82f</entry>
Nov 13 17:27:55 user nova-compute[75100]:       <entry name="uuid">d30816f4-82ec-43b9-bd47-f34190e5c82f</entry>
Nov 13 17:27:55 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:27:55 user nova-compute[75100]:     </system>
Nov 13 17:27:55 user nova-compute[75100]:   </sysinfo>
Nov 13 17:27:55 user nova-compute[75100]:   <os>
Nov 13 17:27:55 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:27:55 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:27:55 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:27:55 user nova-compute[75100]:   </os>
Nov 13 17:27:55 user nova-compute[75100]:   <features>
Nov 13 17:27:55 user nova-compute[75100]:     <acpi/>
Nov 13 17:27:55 user nova-compute[75100]:     <apic/>
Nov 13 17:27:55 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:27:55 user nova-compute[75100]:   </features>
Nov 13 17:27:55 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:27:55 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:27:55 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:27:55 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:27:55 user nova-compute[75100]:   </clock>
Nov 13 17:27:55 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:27:55 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:27:55 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:27:55 user nova-compute[75100]:   </cpu>
Nov 13 17:27:55 user nova-compute[75100]:   <devices>
Nov 13 17:27:55 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:27:55 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:27:55 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk"/>
Nov 13 17:27:55 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:27:55 user nova-compute[75100]:     </disk>
Nov 13 17:27:55 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:27:55 user nova-compute[75100]:       <mac address="fa:16:3e:f0:75:c6"/>
Nov 13 17:27:55 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:27:55 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:27:55 user nova-compute[75100]:       <target dev="tap46c2fa4e-5f"/>
Nov 13 17:27:55 user nova-compute[75100]:     </interface>
Nov 13 17:27:55 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:27:55 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/console.log" append="off"/>
Nov 13 17:27:55 user nova-compute[75100]:     </serial>
Nov 13 17:27:55 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:27:55 user nova-compute[75100]:     <video>
Nov 13 17:27:55 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:27:55 user nova-compute[75100]:     </video>
Nov 13 17:27:55 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:27:55 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:27:55 user nova-compute[75100]:     </rng>
Nov 13 17:27:55 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:27:55 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:27:55 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:27:55 user nova-compute[75100]:     </memballoon>
Nov 13 17:27:55 user nova-compute[75100]:   </devices>
Nov 13 17:27:55 user nova-compute[75100]: </domain>
Nov 13 17:27:55 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:27:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1020004757',display_name='tempest-ServerRescueNegativeTestJSON-server-1020004757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1020004757',id=24,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG40rnWNdDGw6MfW9fJQy1Qo+Xea5DaDsFvBwt2VMxDpCa3aXwJVnMHiiqQw5ZYsyNK2tVKIhgW2j1pldZydkRtj1dqFcGsv+wEELqc/1VWu3BcXOz51BEeAHnpPKQUIAg==',key_name='tempest-keypair-607988464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6c1d1cfd844465e85239be73eb73cec',ramdisk_id='',reservation_id='r-o69if3j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1273984533',owner_user_name='tempest-ServerRescueNegativeTestJSON-1273984533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:27:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33657093c7ab4112994a1b7e997cfb34',uuid=d30816f4-82ec-43b9-bd47-f34190e5c82f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converting VIF {"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=46c2fa4e-5fb5-4798-b9b0-dcf9536addac,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c2fa4e-5f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG os_vif [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=46c2fa4e-5fb5-4798-b9b0-dcf9536addac,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c2fa4e-5f') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5db36592-da6e-549a-bc4c-dbb2cdf55aee', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46c2fa4e-5f, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap46c2fa4e-5f, col_values=(('qos', UUID('c6cbf1fe-beb3-4e2d-93ed-6e5a0a2a8e3e')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap46c2fa4e-5f, col_values=(('external_ids', {'iface-id': '46c2fa4e-5fb5-4798-b9b0-dcf9536addac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:75:c6', 'vm-uuid': 'd30816f4-82ec-43b9-bd47-f34190e5c82f'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:55 user nova-compute[75100]: INFO os_vif [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=46c2fa4e-5fb5-4798-b9b0-dcf9536addac,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c2fa4e-5f')
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No VIF found with MAC fa:16:3e:f0:75:c6, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-79d34d43-8371-4a55-85b8-31d784a62342 req-f6a221a8-d930-4f0f-9e97-6d995e2ca0e7 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updated VIF entry in instance network info cache for port 46c2fa4e-5fb5-4798-b9b0-dcf9536addac. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-79d34d43-8371-4a55-85b8-31d784a62342 req-f6a221a8-d930-4f0f-9e97-6d995e2ca0e7 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updating instance_info_cache with network_info: [{"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:27:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-79d34d43-8371-4a55-85b8-31d784a62342 req-f6a221a8-d930-4f0f-9e97-6d995e2ca0e7 service nova] Releasing lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:27:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-9f0ce6a2-aaaf-4cc6-b1b3-eeee4d63c4a7 req-3b56ac4b-f6ff-4235-ac17-dc10dbb69253 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:27:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9f0ce6a2-aaaf-4cc6-b1b3-eeee4d63c4a7 req-3b56ac4b-f6ff-4235-ac17-dc10dbb69253 service nova] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9f0ce6a2-aaaf-4cc6-b1b3-eeee4d63c4a7 req-3b56ac4b-f6ff-4235-ac17-dc10dbb69253 service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9f0ce6a2-aaaf-4cc6-b1b3-eeee4d63c4a7 req-3b56ac4b-f6ff-4235-ac17-dc10dbb69253 service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-9f0ce6a2-aaaf-4cc6-b1b3-eeee4d63c4a7 req-3b56ac4b-f6ff-4235-ac17-dc10dbb69253 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] No waiting events found dispatching network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:27:56 user nova-compute[75100]: WARNING nova.compute.manager [req-9f0ce6a2-aaaf-4cc6-b1b3-eeee4d63c4a7 req-3b56ac4b-f6ff-4235-ac17-dc10dbb69253 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received unexpected event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac for instance with vm_state building and task_state spawning.
Nov 13 17:27:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:27:58 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Instance spawned successfully.
Nov 13 17:27:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:27:58 user nova-compute[75100]: INFO nova.compute.manager [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 13 17:27:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-f0760734-f318-4217-a475-7fcff00e12d3 req-77421e5b-58b0-48bb-bac2-a5c9a2bde6d2 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f0760734-f318-4217-a475-7fcff00e12d3 req-77421e5b-58b0-48bb-bac2-a5c9a2bde6d2 service nova] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f0760734-f318-4217-a475-7fcff00e12d3 req-77421e5b-58b0-48bb-bac2-a5c9a2bde6d2 service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f0760734-f318-4217-a475-7fcff00e12d3 req-77421e5b-58b0-48bb-bac2-a5c9a2bde6d2 service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:27:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-f0760734-f318-4217-a475-7fcff00e12d3 req-77421e5b-58b0-48bb-bac2-a5c9a2bde6d2 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] No waiting events found dispatching network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:27:58 user nova-compute[75100]: WARNING nova.compute.manager [req-f0760734-f318-4217-a475-7fcff00e12d3 req-77421e5b-58b0-48bb-bac2-a5c9a2bde6d2 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received unexpected event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac for instance with vm_state building and task_state spawning.
Nov 13 17:27:58 user nova-compute[75100]: INFO nova.compute.manager [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Took 5.88 seconds to build instance.
Nov 13 17:27:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-073e8632-f34e-4a97-9e5e-b90fbcbc9f3f tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.970s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:28:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:28:00 user nova-compute[75100]: INFO nova.compute.claims [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Claim successful on node user
Nov 13 17:28:01 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:28:01 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:28:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG nova.policy [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77f5fd132c0e46438884eaffae0beab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf7bde4b774e3dac46d41d32496efa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:28:01 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Creating image(s)
Nov 13 17:28:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "/opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "/opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "/opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Successfully created port: 19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk 1073741824" returned: 0 in 0.056s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Cannot resize image /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Ensure instance console log exists: /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Successfully updated port: 19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "refresh_cache-59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquired lock "refresh_cache-59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-a8faa122-8501-47d5-8d0b-89fe9cfe99d2 req-e5c1bf2f-7b61-4560-a5b3-25061c79e9b1 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Received event network-changed-19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-a8faa122-8501-47d5-8d0b-89fe9cfe99d2 req-e5c1bf2f-7b61-4560-a5b3-25061c79e9b1 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Refreshing instance network info cache due to event network-changed-19a226f1-aa84-4dea-bd99-c1e740d75d57. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:28:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a8faa122-8501-47d5-8d0b-89fe9cfe99d2 req-e5c1bf2f-7b61-4560-a5b3-25061c79e9b1 service nova] Acquiring lock "refresh_cache-59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Updating instance_info_cache with network_info: [{"id": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "address": "fa:16:3e:72:9b:6a", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a226f1-aa", "ovs_interfaceid": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Releasing lock "refresh_cache-59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Instance network_info: |[{"id": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "address": "fa:16:3e:72:9b:6a", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a226f1-aa", "ovs_interfaceid": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a8faa122-8501-47d5-8d0b-89fe9cfe99d2 req-e5c1bf2f-7b61-4560-a5b3-25061c79e9b1 service nova] Acquired lock "refresh_cache-59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-a8faa122-8501-47d5-8d0b-89fe9cfe99d2 req-e5c1bf2f-7b61-4560-a5b3-25061c79e9b1 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Refreshing network info cache for port 19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Start _get_guest_xml network_info=[{"id": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "address": "fa:16:3e:72:9b:6a", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a226f1-aa", "ovs_interfaceid": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:28:03 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:28:03 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-370499798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-370499798',id=25,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-pd3jvel2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:28:01Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "address": "fa:16:3e:72:9b:6a", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a226f1-aa", "ovs_interfaceid": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "address": "fa:16:3e:72:9b:6a", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a226f1-aa", "ovs_interfaceid": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:9b:6a,bridge_name='br-int',has_traffic_filtering=True,id=19a226f1-aa84-4dea-bd99-c1e740d75d57,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a226f1-aa') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'pci_devices' on Instance uuid 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:28:03 user nova-compute[75100]:   <uuid>59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94</uuid>
Nov 13 17:28:03 user nova-compute[75100]:   <name>instance-00000019</name>
Nov 13 17:28:03 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:28:03 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:28:03 user nova-compute[75100]:   <metadata>
Nov 13 17:28:03 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:28:03 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:28:03 user nova-compute[75100]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-370499798</nova:name>
Nov 13 17:28:03 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:28:03</nova:creationTime>
Nov 13 17:28:03 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:28:03 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:28:03 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:28:03 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:28:03 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:28:03 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:28:03 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:28:03 user nova-compute[75100]:       <nova:owner>
Nov 13 17:28:03 user nova-compute[75100]:         <nova:user uuid="77f5fd132c0e46438884eaffae0beab9">tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member</nova:user>
Nov 13 17:28:03 user nova-compute[75100]:         <nova:project uuid="f1bf7bde4b774e3dac46d41d32496efa">tempest-ServerBootFromVolumeStableRescueTest-1217233624</nova:project>
Nov 13 17:28:03 user nova-compute[75100]:       </nova:owner>
Nov 13 17:28:03 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:28:03 user nova-compute[75100]:       <nova:ports>
Nov 13 17:28:03 user nova-compute[75100]:         <nova:port uuid="19a226f1-aa84-4dea-bd99-c1e740d75d57">
Nov 13 17:28:03 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 17:28:03 user nova-compute[75100]:         </nova:port>
Nov 13 17:28:03 user nova-compute[75100]:       </nova:ports>
Nov 13 17:28:03 user nova-compute[75100]:     </nova:instance>
Nov 13 17:28:03 user nova-compute[75100]:   </metadata>
Nov 13 17:28:03 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:28:03 user nova-compute[75100]:     <system>
Nov 13 17:28:03 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:28:03 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:28:03 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:28:03 user nova-compute[75100]:       <entry name="serial">59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94</entry>
Nov 13 17:28:03 user nova-compute[75100]:       <entry name="uuid">59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94</entry>
Nov 13 17:28:03 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:28:03 user nova-compute[75100]:     </system>
Nov 13 17:28:03 user nova-compute[75100]:   </sysinfo>
Nov 13 17:28:03 user nova-compute[75100]:   <os>
Nov 13 17:28:03 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:28:03 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:28:03 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:28:03 user nova-compute[75100]:   </os>
Nov 13 17:28:03 user nova-compute[75100]:   <features>
Nov 13 17:28:03 user nova-compute[75100]:     <acpi/>
Nov 13 17:28:03 user nova-compute[75100]:     <apic/>
Nov 13 17:28:03 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:28:03 user nova-compute[75100]:   </features>
Nov 13 17:28:03 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:28:03 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:28:03 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:28:03 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:28:03 user nova-compute[75100]:   </clock>
Nov 13 17:28:03 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:28:03 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:28:03 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:28:03 user nova-compute[75100]:   </cpu>
Nov 13 17:28:03 user nova-compute[75100]:   <devices>
Nov 13 17:28:03 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:28:03 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:28:03 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk"/>
Nov 13 17:28:03 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:28:03 user nova-compute[75100]:     </disk>
Nov 13 17:28:03 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:28:03 user nova-compute[75100]:       <mac address="fa:16:3e:72:9b:6a"/>
Nov 13 17:28:03 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:28:03 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:28:03 user nova-compute[75100]:       <target dev="tap19a226f1-aa"/>
Nov 13 17:28:03 user nova-compute[75100]:     </interface>
Nov 13 17:28:03 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:28:03 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/console.log" append="off"/>
Nov 13 17:28:03 user nova-compute[75100]:     </serial>
Nov 13 17:28:03 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:28:03 user nova-compute[75100]:     <video>
Nov 13 17:28:03 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:28:03 user nova-compute[75100]:     </video>
Nov 13 17:28:03 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:28:03 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:28:03 user nova-compute[75100]:     </rng>
Nov 13 17:28:03 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:28:03 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:28:03 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:28:03 user nova-compute[75100]:     </memballoon>
Nov 13 17:28:03 user nova-compute[75100]:   </devices>
Nov 13 17:28:03 user nova-compute[75100]: </domain>
Nov 13 17:28:03 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-370499798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-370499798',id=25,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-pd3jvel2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:28:01Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "address": "fa:16:3e:72:9b:6a", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a226f1-aa", "ovs_interfaceid": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "address": "fa:16:3e:72:9b:6a", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a226f1-aa", "ovs_interfaceid": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:9b:6a,bridge_name='br-int',has_traffic_filtering=True,id=19a226f1-aa84-4dea-bd99-c1e740d75d57,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a226f1-aa') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG os_vif [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:9b:6a,bridge_name='br-int',has_traffic_filtering=True,id=19a226f1-aa84-4dea-bd99-c1e740d75d57,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a226f1-aa') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e4bc659-053b-5338-8973-00ebd5a44649', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19a226f1-aa, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19a226f1-aa, col_values=(('qos', UUID('0246887e-b556-4036-9b7e-e26ba287fafe')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19a226f1-aa, col_values=(('external_ids', {'iface-id': '19a226f1-aa84-4dea-bd99-c1e740d75d57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:9b:6a', 'vm-uuid': '59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:03 user nova-compute[75100]: INFO os_vif [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:9b:6a,bridge_name='br-int',has_traffic_filtering=True,id=19a226f1-aa84-4dea-bd99-c1e740d75d57,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a226f1-aa')
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No VIF found with MAC fa:16:3e:72:9b:6a, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-a8faa122-8501-47d5-8d0b-89fe9cfe99d2 req-e5c1bf2f-7b61-4560-a5b3-25061c79e9b1 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Updated VIF entry in instance network info cache for port 19a226f1-aa84-4dea-bd99-c1e740d75d57. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-a8faa122-8501-47d5-8d0b-89fe9cfe99d2 req-e5c1bf2f-7b61-4560-a5b3-25061c79e9b1 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Updating instance_info_cache with network_info: [{"id": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "address": "fa:16:3e:72:9b:6a", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a226f1-aa", "ovs_interfaceid": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:28:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a8faa122-8501-47d5-8d0b-89fe9cfe99d2 req-e5c1bf2f-7b61-4560-a5b3-25061c79e9b1 service nova] Releasing lock "refresh_cache-59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:28:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-37418b3f-dac2-4f36-ab46-dde6865761c1 req-fb6e4c45-4292-40e5-a97c-0310a0b4ab2d service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Received event network-vif-plugged-19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-37418b3f-dac2-4f36-ab46-dde6865761c1 req-fb6e4c45-4292-40e5-a97c-0310a0b4ab2d service nova] Acquiring lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-37418b3f-dac2-4f36-ab46-dde6865761c1 req-fb6e4c45-4292-40e5-a97c-0310a0b4ab2d service nova] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-37418b3f-dac2-4f36-ab46-dde6865761c1 req-fb6e4c45-4292-40e5-a97c-0310a0b4ab2d service nova] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-37418b3f-dac2-4f36-ab46-dde6865761c1 req-fb6e4c45-4292-40e5-a97c-0310a0b4ab2d service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] No waiting events found dispatching network-vif-plugged-19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:28:04 user nova-compute[75100]: WARNING nova.compute.manager [req-37418b3f-dac2-4f36-ab46-dde6865761c1 req-fb6e4c45-4292-40e5-a97c-0310a0b4ab2d service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Received unexpected event network-vif-plugged-19a226f1-aa84-4dea-bd99-c1e740d75d57 for instance with vm_state building and task_state spawning.
Nov 13 17:28:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:05 user nova-compute[75100]: INFO nova.compute.manager [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Terminating instance
Nov 13 17:28:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:28:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Instance destroyed successfully.
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lazy-loading 'resources' on Instance uuid 64c9f78b-8ce5-4328-9fb0-93715df6135f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1879098934',display_name='tempest-ServerActionsTestOtherB-server-1879098934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1879098934',id=6,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPtAAW3TgTxHf+TUITy0Mmc2phtGIX31UWPLC6Ax00Ra3rvR7rorviHUXMJmTRs8r7vW2IjeukFIO8Ah6Z/JWvZwng0Wq3UlZJ7OxB5Mha2gh4q+d5taNiDQoe9oXIHuA==',key_name='tempest-keypair-2067438742',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:25:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fa1230bfae049af9ce657d6889eddad',ramdisk_id='',reservation_id='r-78tnxuif',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1067719084',owner_user_name='tempest-ServerActionsTestOtherB-1067719084-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:25:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='047fae6bc2134ea2a43fb06dbeabbb0b',uuid=64c9f78b-8ce5-4328-9fb0-93715df6135f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converting VIF {"id": "4d8ea93b-b607-4f22-ad01-9577465b5997", "address": "fa:16:3e:f0:3f:b9", "network": {"id": "e3f89835-6e6b-4921-9b8f-744ad99c0da0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-30287792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa1230bfae049af9ce657d6889eddad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d8ea93b-b6", "ovs_interfaceid": "4d8ea93b-b607-4f22-ad01-9577465b5997", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_vif [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d8ea93b-b6, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3db5ea5b-7e3c-4079-ae9a-66e4f70bc041) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:06 user nova-compute[75100]: INFO os_vif [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:3f:b9,bridge_name='br-int',has_traffic_filtering=True,id=4d8ea93b-b607-4f22-ad01-9577465b5997,network=Network(e3f89835-6e6b-4921-9b8f-744ad99c0da0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d8ea93b-b6')
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEVWivnO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:28:06 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91c36b0-a4a9-400c-bfec-908bc56d1992]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:28:06 user nova-compute[75100]: No targets found.
Nov 13 17:28:06 user nova-compute[75100]: iSNS:
Nov 13 17:28:06 user nova-compute[75100]: No targets found.
Nov 13 17:28:06 user nova-compute[75100]: STATIC:
Nov 13 17:28:06 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4
Nov 13 17:28:06 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:06 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:06 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28
Nov 13 17:28:06 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:06 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:06 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:28:06 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:06 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:06 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e
Nov 13 17:28:06 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:06 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:06 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12
Nov 13 17:28:06 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:06 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:06 user nova-compute[75100]: FIRMWARE:
Nov 13 17:28:06 user nova-compute[75100]: No targets found.
Nov 13 17:28:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:28:06 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:28:06 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6676ce-3a7a-4f50-b565-61931c71c376]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[412bcaa1-62d4-42a7-ac5e-a3d00084aca7]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:06 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:28:06 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:28:06 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:06 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)
Nov 13 17:28:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:06 user nova-compute[75100]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 (non-flash)
Nov 13 17:28:06 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:28:06 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:06 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)
Nov 13 17:28:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38c3c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b157e7-b782-4682-b547-f0503b0cecbb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ec271f-6b8b-4378-88e8-3079adea8ec8]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e09a17-a410-419a-9101-26c8d62437ff]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:06 user nova-compute[75100]: INFO nova.compute.manager [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Detaching volume a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3519ef4a-8620-4425-b055-1ac63eb24f0a]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a8cdae4-2b06-4c98-b33a-30c1b8d48bb0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:06 user nova-compute[75100]: INFO nova.virt.block_device [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Attempting to driver detach volume a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e from mountpoint /dev/vdb
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Attempting to detach device vdb from instance 5933add2-b8bb-448d-a054-d8527e3c49f8 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:28:06 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:28:06 user nova-compute[75100]:   <source dev="/dev/sdf"/>
Nov 13 17:28:06 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:28:06 user nova-compute[75100]:   <serial>a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e</serial>
Nov 13 17:28:06 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 17:28:06 user nova-compute[75100]: </disk>
Nov 13 17:28:06 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:28:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully detached device vdb from instance 5933add2-b8bb-448d-a054-d8527e3c49f8 from the persistent domain config.
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5933add2-b8bb-448d-a054-d8527e3c49f8 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:28:06 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:28:06 user nova-compute[75100]:   <source dev="/dev/sdf"/>
Nov 13 17:28:06 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:28:06 user nova-compute[75100]:   <serial>a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e</serial>
Nov 13 17:28:06 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 17:28:06 user nova-compute[75100]: </disk>
Nov 13 17:28:06 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1437cda-b5ea-4d51-b688-c04e94c7b33d]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260]
Nov 13 17:28:06 user nova-compute[75100]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4, portal: 172.16.0.220,3260] successful.
Nov 13 17:28:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb32c0e-ed04-4dc9-b83c-805371205ba4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0df58e0-a78a-435b-8ead-6d6dfc954c5e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] <== disconnect_volume: return (318ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:28:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Deleting instance files /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f_del
Nov 13 17:28:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Deletion of /opt/stack/data/nova/instances/64c9f78b-8ce5-4328-9fb0-93715df6135f_del complete
Nov 13 17:28:06 user nova-compute[75100]: INFO nova.compute.manager [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.objects.instance [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquired lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.network.neutron [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.objects.instance [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'info_cache' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.objects.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:28:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Instance spawned successfully.
Nov 13 17:28:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Received event network-vif-plugged-19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] Acquiring lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] No waiting events found dispatching network-vif-plugged-19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:28:07 user nova-compute[75100]: WARNING nova.compute.manager [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Received unexpected event network-vif-plugged-19a226f1-aa84-4dea-bd99-c1e740d75d57 for instance with vm_state building and task_state spawning.
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-unplugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-unplugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-unplugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] Acquiring lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] No waiting events found dispatching network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:28:07 user nova-compute[75100]: WARNING nova.compute.manager [req-86540dd3-4136-4322-8323-d2bba05072ea req-e3d1927e-01c2-4933-af88-1965091d0d18 service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received unexpected event network-vif-plugged-4d8ea93b-b607-4f22-ad01-9577465b5997 for instance with vm_state active and task_state deleting.
Nov 13 17:28:07 user nova-compute[75100]: INFO nova.compute.manager [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:28:07 user nova-compute[75100]: INFO nova.compute.manager [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Took 6.32 seconds to build instance.
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5933add2-b8bb-448d-a054-d8527e3c49f8 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7e1a8d44-64fb-4ac6-af4d-271382f8a461 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.419s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.network.neutron [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Updating instance_info_cache with network_info: [{"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Releasing lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:28:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance destroyed successfully.
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.objects.instance [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'resources' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.objects.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-562088828',display_name='tempest-AttachVolumeTestJSON-server-562088828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-562088828',id=18,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0MMK9PR6LTDNy8k+1ome/7/JGCOaYN5Lt3qsENjyVjimlQSRra7KUpWuRZjUfo9P1bMI6EsGXlo4/Ypy8Z5ugzSg6hpliFDTFbfMjRXxyPD7FFbeVCCUZ1dM7RZ0z3bQ==',key_name='tempest-keypair-673460478',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='43327ade8a814488bb141835e2ac331b',ramdisk_id='',reservation_id='r-4p2x10pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2091682056',owner_user_name='tempest-AttachVolumeTestJSON-2091682056-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:26:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15122cbfe21b4775b679285eeb4beff7',uuid=d2c4575b-ef8d-4a9d-9650-459366b7227e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converting VIF {"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG os_vif [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bb5ab2c-fa, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1422a10f-1cb0-46ad-acf6-8ea722489e0c) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:07 user nova-compute[75100]: INFO os_vif [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa')
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkbQJzAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:28:07 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:28:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e77d9c-d539-44f1-b4c5-68227a481bf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:28:07 user nova-compute[75100]: No targets found.
Nov 13 17:28:07 user nova-compute[75100]: iSNS:
Nov 13 17:28:07 user nova-compute[75100]: No targets found.
Nov 13 17:28:07 user nova-compute[75100]: STATIC:
Nov 13 17:28:07 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28
Nov 13 17:28:07 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:07 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:07 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:28:07 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:07 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:07 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e
Nov 13 17:28:07 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:07 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:07 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12
Nov 13 17:28:07 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:07 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:07 user nova-compute[75100]: FIRMWARE:
Nov 13 17:28:07 user nova-compute[75100]: No targets found.
Nov 13 17:28:07 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:28:07 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:28:07 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:28:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Took 1.24 seconds to deallocate network for instance.
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee05069-76b9-43cf-941d-1949026bffd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-fac7d709-7646-4ec5-95c3-795036bfcd66 req-a94c093a-5589-4420-a571-86430dea8b8c service nova] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Received event network-vif-deleted-4d8ea93b-b607-4f22-ad01-9577465b5997 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2f748b-618b-4326-ba99-b19130229e76]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38f5cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12'): ({'sdg'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Removing single pathed devices sdg {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d20659-dd06-4fb5-ad3a-e35bd212a330]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5303a41-944b-45c9-b9f2-49affea6d573]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Flushing IO for device /dev/sdg {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f0584e-069e-4396-9509-2395213dcbb1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f4e7a3-5a9a-4571-aad0-df2b644d2c69]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a253f57-b573-442c-aa45-cc0b2d3c12da]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc3ace4-8044-410e-870e-50d7f1e602c8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260]
Nov 13 17:28:08 user nova-compute[75100]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260] successful.
Nov 13 17:28:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3d3860-13d9-476e-9de2-7893779fbe4c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] <== disconnect_volume: return (382ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Start _get_guest_xml network_info=[{"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'f666f44a-c9ee-492c-aacb-a0470bff2474', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkbQJzAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'd2c4575b-ef8d-4a9d-9650-459366b7227e', 'attached_at': '', 'detached_at': '', 'volume_id': '96d5831f-9831-46ee-a088-fcd53a8b9e12', 'serial': '96d5831f-9831-46ee-a088-fcd53a8b9e12'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.objects.instance [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'numa_topology' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.objects.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:28:08 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:28:08 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.objects.instance [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'vcpu_model' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.objects.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkbQJzAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:28:08 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:28:08 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:28:08 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2289a12d-4234-43e2-9890-eeb7fb2b96d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:28:08 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b111004-80ce-42c1-89fb-3a896fb122e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12] added
Nov 13 17:28:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa21f1d-cbcd-4f17-91c2-727217980716]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cb002d-883f-4a89-97ee-2eab36a2f4e6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XkbQJzAD {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XkbQJzAD" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9862d013-b8ff-4644-88b9-24080d26c2d9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XkbQJzAD'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b606c6ac-2fc3-4309-9777-dd06112bba50]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d8c2b3-444f-4e86-87d2-9c9ca2cda1f4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c600a5b7-b75b-4e6e-807a-9098538aa9dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260]
Nov 13 17:28:08 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260] successful.
Nov 13 17:28:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6b1c3b-c2f5-498c-90d4-e9799575f8c4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[383db9c7-c8e1-49f3-825b-5ecd7f5c5d87]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:08 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2525ff-9bf9-4a78-9e26-7d76bbbc276a]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkbQJzAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:28:08 user nova-compute[75100]: INFO nova.compute.manager [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] [instance: 64c9f78b-8ce5-4328-9fb0-93715df6135f] Took 0.89 seconds to detach 1 volumes for instance.
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:09 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Deleted allocations for instance 64c9f78b-8ce5-4328-9fb0-93715df6135f
Nov 13 17:28:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a1e2020d-edd4-498c-8f6e-ac4550267192 tempest-ServerActionsTestOtherB-1067719084 tempest-ServerActionsTestOtherB-1067719084-project-member] Lock "64c9f78b-8ce5-4328-9fb0-93715df6135f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.066s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26434373331613136', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434373331613136', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-562088828',display_name='tempest-AttachVolumeTestJSON-server-562088828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-562088828',id=18,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0MMK9PR6LTDNy8k+1ome/7/JGCOaYN5Lt3qsENjyVjimlQSRra7KUpWuRZjUfo9P1bMI6EsGXlo4/Ypy8Z5ugzSg6hpliFDTFbfMjRXxyPD7FFbeVCCUZ1dM7RZ0z3bQ==',key_name='tempest-keypair-673460478',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='43327ade8a814488bb141835e2ac331b',ramdisk_id='',reservation_id='r-4p2x10pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2091682056',owner_user_name='tempest-AttachVolumeTestJSON-2091682056-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:26:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15122cbfe21b4775b679285eeb4beff7',uuid=d2c4575b-ef8d-4a9d-9650-459366b7227e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converting VIF {"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG nova.objects.instance [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'pci_devices' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG nova.objects.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:28:09 user nova-compute[75100]:   <uuid>d2c4575b-ef8d-4a9d-9650-459366b7227e</uuid>
Nov 13 17:28:09 user nova-compute[75100]:   <name>instance-00000012</name>
Nov 13 17:28:09 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:28:09 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:28:09 user nova-compute[75100]:   <metadata>
Nov 13 17:28:09 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:28:09 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:28:09 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeTestJSON-server-562088828</nova:name>
Nov 13 17:28:09 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:28:08</nova:creationTime>
Nov 13 17:28:09 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:28:09 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:28:09 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:28:09 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:28:09 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:28:09 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:28:09 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:28:09 user nova-compute[75100]:       <nova:owner>
Nov 13 17:28:09 user nova-compute[75100]:         <nova:user uuid="15122cbfe21b4775b679285eeb4beff7">tempest-AttachVolumeTestJSON-2091682056-project-member</nova:user>
Nov 13 17:28:09 user nova-compute[75100]:         <nova:project uuid="43327ade8a814488bb141835e2ac331b">tempest-AttachVolumeTestJSON-2091682056</nova:project>
Nov 13 17:28:09 user nova-compute[75100]:       </nova:owner>
Nov 13 17:28:09 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:28:09 user nova-compute[75100]:       <nova:ports>
Nov 13 17:28:09 user nova-compute[75100]:         <nova:port uuid="0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd">
Nov 13 17:28:09 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 17:28:09 user nova-compute[75100]:         </nova:port>
Nov 13 17:28:09 user nova-compute[75100]:       </nova:ports>
Nov 13 17:28:09 user nova-compute[75100]:     </nova:instance>
Nov 13 17:28:09 user nova-compute[75100]:   </metadata>
Nov 13 17:28:09 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:28:09 user nova-compute[75100]:     <system>
Nov 13 17:28:09 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:28:09 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:28:09 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:28:09 user nova-compute[75100]:       <entry name="serial">d2c4575b-ef8d-4a9d-9650-459366b7227e</entry>
Nov 13 17:28:09 user nova-compute[75100]:       <entry name="uuid">d2c4575b-ef8d-4a9d-9650-459366b7227e</entry>
Nov 13 17:28:09 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:28:09 user nova-compute[75100]:     </system>
Nov 13 17:28:09 user nova-compute[75100]:   </sysinfo>
Nov 13 17:28:09 user nova-compute[75100]:   <os>
Nov 13 17:28:09 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:28:09 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:28:09 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:28:09 user nova-compute[75100]:   </os>
Nov 13 17:28:09 user nova-compute[75100]:   <features>
Nov 13 17:28:09 user nova-compute[75100]:     <acpi/>
Nov 13 17:28:09 user nova-compute[75100]:     <apic/>
Nov 13 17:28:09 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:28:09 user nova-compute[75100]:   </features>
Nov 13 17:28:09 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:28:09 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:28:09 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:28:09 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:28:09 user nova-compute[75100]:   </clock>
Nov 13 17:28:09 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:28:09 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:28:09 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:28:09 user nova-compute[75100]:   </cpu>
Nov 13 17:28:09 user nova-compute[75100]:   <devices>
Nov 13 17:28:09 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:28:09 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:28:09 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk"/>
Nov 13 17:28:09 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:28:09 user nova-compute[75100]:     </disk>
Nov 13 17:28:09 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:28:09 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:28:09 user nova-compute[75100]:       <source dev="/dev/sdd"/>
Nov 13 17:28:09 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:28:09 user nova-compute[75100]:       <serial>96d5831f-9831-46ee-a088-fcd53a8b9e12</serial>
Nov 13 17:28:09 user nova-compute[75100]:     </disk>
Nov 13 17:28:09 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:28:09 user nova-compute[75100]:       <mac address="fa:16:3e:00:52:b6"/>
Nov 13 17:28:09 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:28:09 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:28:09 user nova-compute[75100]:       <target dev="tap0bb5ab2c-fa"/>
Nov 13 17:28:09 user nova-compute[75100]:     </interface>
Nov 13 17:28:09 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:28:09 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/console.log" append="off"/>
Nov 13 17:28:09 user nova-compute[75100]:     </serial>
Nov 13 17:28:09 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:28:09 user nova-compute[75100]:     <video>
Nov 13 17:28:09 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:28:09 user nova-compute[75100]:     </video>
Nov 13 17:28:09 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:28:09 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:28:09 user nova-compute[75100]:     </rng>
Nov 13 17:28:09 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:28:09 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:28:09 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:28:09 user nova-compute[75100]:     </memballoon>
Nov 13 17:28:09 user nova-compute[75100]:   </devices>
Nov 13 17:28:09 user nova-compute[75100]: </domain>
Nov 13 17:28:09 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:28:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG nova.objects.instance [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'trusted_certs' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG nova.objects.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Cannot resize image /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG nova.objects.instance [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'migration_context' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG nova.objects.base [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-562088828',display_name='tempest-AttachVolumeTestJSON-server-562088828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-562088828',id=18,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0MMK9PR6LTDNy8k+1ome/7/JGCOaYN5Lt3qsENjyVjimlQSRra7KUpWuRZjUfo9P1bMI6EsGXlo4/Ypy8Z5ugzSg6hpliFDTFbfMjRXxyPD7FFbeVCCUZ1dM7RZ0z3bQ==',key_name='tempest-keypair-673460478',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='43327ade8a814488bb141835e2ac331b',ramdisk_id='',reservation_id='r-4p2x10pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2091682056',owner_user_name='tempest-AttachVolumeTestJSON-2091682056-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:26:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15122cbfe21b4775b679285eeb4beff7',uuid=d2c4575b-ef8d-4a9d-9650-459366b7227e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converting VIF {"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG os_vif [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92bcfe63-957a-5dc6-9286-3f885375511d', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bb5ab2c-fa, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bb5ab2c-fa, col_values=(('qos', UUID('85713acc-9dd2-4dee-b9ad-0e82fc72ec9b')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bb5ab2c-fa, col_values=(('external_ids', {'iface-id': '0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:52:b6', 'vm-uuid': 'd2c4575b-ef8d-4a9d-9650-459366b7227e'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:28:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:10 user nova-compute[75100]: INFO os_vif [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa')
Nov 13 17:28:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-364625a0-f1ac-41d8-891a-7c3f94364fac req-b564d3e4-9f6c-419a-b6b8-5a20adc58220 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-364625a0-f1ac-41d8-891a-7c3f94364fac req-b564d3e4-9f6c-419a-b6b8-5a20adc58220 service nova] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-364625a0-f1ac-41d8-891a-7c3f94364fac req-b564d3e4-9f6c-419a-b6b8-5a20adc58220 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-364625a0-f1ac-41d8-891a-7c3f94364fac req-b564d3e4-9f6c-419a-b6b8-5a20adc58220 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-364625a0-f1ac-41d8-891a-7c3f94364fac req-b564d3e4-9f6c-419a-b6b8-5a20adc58220 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] No waiting events found dispatching network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:28:12 user nova-compute[75100]: WARNING nova.compute.manager [req-364625a0-f1ac-41d8-891a-7c3f94364fac req-b564d3e4-9f6c-419a-b6b8-5a20adc58220 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received unexpected event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd for instance with vm_state stopped and task_state powering-on.
Nov 13 17:28:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:12 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a is timed out.
Nov 13 17:28:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Successfully detached device vdb from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the live domain config.
Nov 13 17:28:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFGORIcw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:28:12 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[adde25a1-a437-438a-bb4b-58b92c8edda9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:28:12 user nova-compute[75100]: No targets found.
Nov 13 17:28:12 user nova-compute[75100]: iSNS:
Nov 13 17:28:12 user nova-compute[75100]: No targets found.
Nov 13 17:28:12 user nova-compute[75100]: STATIC:
Nov 13 17:28:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28
Nov 13 17:28:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:28:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e
Nov 13 17:28:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:12 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12
Nov 13 17:28:12 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:12 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:12 user nova-compute[75100]: FIRMWARE:
Nov 13 17:28:12 user nova-compute[75100]: No targets found.
Nov 13 17:28:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:28:12 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:28:12 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f82c5b-3f6f-4168-a3f0-9c3bc6a7d08e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2afa095-cc20-430e-9dc8-1d86a7fa27d0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:12 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:28:12 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)
Nov 13 17:28:12 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:12 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:28:12 user nova-compute[75100]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 (non-flash)
Nov 13 17:28:12 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38e4f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc0c325-4ae0-4fad-abfe-d223c982aa92]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bf0266-9c90-4100-b233-5a6f0e3739dd]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[903f1610-346b-40b2-82f2-9ef70b8aff3b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a10ec7b-a0d2-412b-b86a-3670049cda2f]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b165e690-e3bb-4e17-a6a2-514be4a71e72]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0a199d-2c0b-4376-87d1-71749018b80f]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28, portal: 172.16.0.220,3260]
Nov 13 17:28:12 user nova-compute[75100]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28, portal: 172.16.0.220,3260] successful.
Nov 13 17:28:12 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b4a93f1-47ee-492a-ad10-16bdc0fa1d28 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0937c8b4-d2ac-4fac-9f04-bcf43e31ae9b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:28:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] <== disconnect_volume: return (295ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:28:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:28:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'flavor' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d8f5a827-b0dc-4823-ae43-841848b4192c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.650s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:28:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance rebooted successfully.
Nov 13 17:28:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-664fd4fd-206b-4415-b38e-bb90f48ced0b tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:28:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-bfe84a4c-a78b-4252-995c-86eb2c056a8e req-16769f8d-97ac-4ce5-afeb-14c975bcc5ac service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bfe84a4c-a78b-4252-995c-86eb2c056a8e req-16769f8d-97ac-4ce5-afeb-14c975bcc5ac service nova] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bfe84a4c-a78b-4252-995c-86eb2c056a8e req-16769f8d-97ac-4ce5-afeb-14c975bcc5ac service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bfe84a4c-a78b-4252-995c-86eb2c056a8e req-16769f8d-97ac-4ce5-afeb-14c975bcc5ac service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-bfe84a4c-a78b-4252-995c-86eb2c056a8e req-16769f8d-97ac-4ce5-afeb-14c975bcc5ac service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] No waiting events found dispatching network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:28:14 user nova-compute[75100]: WARNING nova.compute.manager [req-bfe84a4c-a78b-4252-995c-86eb2c056a8e req-16769f8d-97ac-4ce5-afeb-14c975bcc5ac service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received unexpected event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd for instance with vm_state stopped and task_state powering-on.
Nov 13 17:28:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:28:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:28:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:22 user nova-compute[75100]: INFO nova.compute.manager [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Terminating instance
Nov 13 17:28:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-b8f51a17-5e98-4a98-89bc-cd498d50f7ee req-ace84738-a833-4293-b80b-fdfad68f0af8 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Received event network-vif-unplugged-a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b8f51a17-5e98-4a98-89bc-cd498d50f7ee req-ace84738-a833-4293-b80b-fdfad68f0af8 service nova] Acquiring lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b8f51a17-5e98-4a98-89bc-cd498d50f7ee req-ace84738-a833-4293-b80b-fdfad68f0af8 service nova] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b8f51a17-5e98-4a98-89bc-cd498d50f7ee req-ace84738-a833-4293-b80b-fdfad68f0af8 service nova] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-b8f51a17-5e98-4a98-89bc-cd498d50f7ee req-ace84738-a833-4293-b80b-fdfad68f0af8 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] No waiting events found dispatching network-vif-unplugged-a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-b8f51a17-5e98-4a98-89bc-cd498d50f7ee req-ace84738-a833-4293-b80b-fdfad68f0af8 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Received event network-vif-unplugged-a9932400-67ab-4509-adbc-f802c060e33e for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Instance destroyed successfully.
Nov 13 17:28:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lazy-loading 'resources' on Instance uuid 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:26:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1075897505',display_name='tempest-VolumesAdminNegativeTest-server-1075897505',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1075897505',id=22,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:26:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6052793c6f6e40ce9f63a04a0afd609f',ramdisk_id='',reservation_id='r-1s1hmxtf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-57814532',owner_user_name='tempest-VolumesAdminNegativeTest-57814532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:26:35Z,user_data=None,user_id='4bb17b2fc6a4406ca5c476d267ff6f2a',uuid=9ef6e164-8da5-49b1-b1a7-7eff19aef9fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9932400-67ab-4509-adbc-f802c060e33e", "address": "fa:16:3e:ec:d7:bb", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9932400-67", "ovs_interfaceid": "a9932400-67ab-4509-adbc-f802c060e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Converting VIF {"id": "a9932400-67ab-4509-adbc-f802c060e33e", "address": "fa:16:3e:ec:d7:bb", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9932400-67", "ovs_interfaceid": "a9932400-67ab-4509-adbc-f802c060e33e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d7:bb,bridge_name='br-int',has_traffic_filtering=True,id=a9932400-67ab-4509-adbc-f802c060e33e,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9932400-67') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG os_vif [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d7:bb,bridge_name='br-int',has_traffic_filtering=True,id=a9932400-67ab-4509-adbc-f802c060e33e,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9932400-67') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9932400-67, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e5c3553-832b-4955-b020-7126d2777ea6) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:22 user nova-compute[75100]: INFO os_vif [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d7:bb,bridge_name='br-int',has_traffic_filtering=True,id=a9932400-67ab-4509-adbc-f802c060e33e,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9932400-67')
Nov 13 17:28:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Deleting instance files /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa_del
Nov 13 17:28:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Deletion of /opt/stack/data/nova/instances/9ef6e164-8da5-49b1-b1a7-7eff19aef9fa_del complete
Nov 13 17:28:23 user nova-compute[75100]: INFO nova.compute.manager [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 13 17:28:23 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:28:23 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Took 0.42 seconds to deallocate network for instance.
Nov 13 17:28:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-235d7d40-7278-455f-ae7a-412ef3620e9d req-0062429f-6f84-49dd-8e03-85ab734093ae service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Received event network-vif-deleted-a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:23 user nova-compute[75100]: INFO nova.compute.manager [req-235d7d40-7278-455f-ae7a-412ef3620e9d req-0062429f-6f84-49dd-8e03-85ab734093ae service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Neutron deleted interface a9932400-67ab-4509-adbc-f802c060e33e; detaching it from the instance and deleting it from the info cache
Nov 13 17:28:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-235d7d40-7278-455f-ae7a-412ef3620e9d req-0062429f-6f84-49dd-8e03-85ab734093ae service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-235d7d40-7278-455f-ae7a-412ef3620e9d req-0062429f-6f84-49dd-8e03-85ab734093ae service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Detach interface failed, port_id=a9932400-67ab-4509-adbc-f802c060e33e, reason: Instance 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:28:23 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:24 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Deleted allocations for instance 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7229d13c-ae51-4bd3-b4a7-8bb7ead416c1 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.891s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-08af8e66-d038-48b6-8abf-3bf024067a53 req-7979b3ce-3e10-48be-8a32-d193c1218674 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Received event network-vif-plugged-a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-08af8e66-d038-48b6-8abf-3bf024067a53 req-7979b3ce-3e10-48be-8a32-d193c1218674 service nova] Acquiring lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-08af8e66-d038-48b6-8abf-3bf024067a53 req-7979b3ce-3e10-48be-8a32-d193c1218674 service nova] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-08af8e66-d038-48b6-8abf-3bf024067a53 req-7979b3ce-3e10-48be-8a32-d193c1218674 service nova] Lock "9ef6e164-8da5-49b1-b1a7-7eff19aef9fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-08af8e66-d038-48b6-8abf-3bf024067a53 req-7979b3ce-3e10-48be-8a32-d193c1218674 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] No waiting events found dispatching network-vif-plugged-a9932400-67ab-4509-adbc-f802c060e33e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:28:24 user nova-compute[75100]: WARNING nova.compute.manager [req-08af8e66-d038-48b6-8abf-3bf024067a53 req-7979b3ce-3e10-48be-8a32-d193c1218674 service nova] [instance: 9ef6e164-8da5-49b1-b1a7-7eff19aef9fa] Received unexpected event network-vif-plugged-a9932400-67ab-4509-adbc-f802c060e33e for instance with vm_state deleted and task_state None.
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5933add2-b8bb-448d-a054-d8527e3c49f8 is timed out.
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully detached device vdb from instance 5933add2-b8bb-448d-a054-d8527e3c49f8 from the live domain config.
Nov 13 17:28:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SlRENGhL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:28:27 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[268cadcc-a140-413b-b7e9-de8b5c3609db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:28:27 user nova-compute[75100]: No targets found.
Nov 13 17:28:27 user nova-compute[75100]: iSNS:
Nov 13 17:28:27 user nova-compute[75100]: No targets found.
Nov 13 17:28:27 user nova-compute[75100]: STATIC:
Nov 13 17:28:27 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:28:27 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:27 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:27 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e
Nov 13 17:28:27 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:27 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:27 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12
Nov 13 17:28:27 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:28:27 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:28:27 user nova-compute[75100]: FIRMWARE:
Nov 13 17:28:27 user nova-compute[75100]: No targets found.
Nov 13 17:28:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:28:27 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:28:27 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dfa45e-b579-4b58-838d-c9f4d8b8253d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[df71b13c-5748-4cbc-9d2a-e78938250f81]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:27 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:28:27 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:27 user nova-compute[75100]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e (non-flash)
Nov 13 17:28:27 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda893cb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e'): ({'sdf'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Removing single pathed devices sdf {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[66efde1a-9b76-4e67-ac47-195e6f18b1e6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65faee5-1873-4d2d-972f-7d613c69ab86]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flushing IO for device /dev/sdf {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[92edd56f-694f-406b-aa01-d6de71851d67]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4da2884-4aef-4e1b-a2af-13baaf6ae34e]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[df68ac75-6829-49fb-b22d-f4429299ebcc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3531c7cd-b23c-452c-9d62-b4f1ff2abc78]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260]
Nov 13 17:28:27 user nova-compute[75100]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e, portal: 172.16.0.220,3260] successful.
Nov 13 17:28:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a19a6c0b-bed1-4f6b-8048-d1fdcb11f07e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a921da5c-26e4-42fb-bb4d-5ffd435008b3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== disconnect_volume: return (364ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.objects.instance [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lazy-loading 'flavor' on Instance uuid 5933add2-b8bb-448d-a054-d8527e3c49f8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:28:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7335MB free_disk=25.190574645996094GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-08bdc5a8-74c6-4078-977a-23df4f636fa3 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.080s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 5933add2-b8bb-448d-a054-d8527e3c49f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance e96eb705-85e2-4cce-a91d-5d319b1b5083 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d2c4575b-ef8d-4a9d-9650-459366b7227e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d4f158c3-bcd5-4d5b-8c70-04726b17081a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance a10bd002-4f94-4907-994e-7b9f2da6ca3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d30816f4-82ec-43b9-bd47-f34190e5c82f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:28:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:28:29 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:28:29 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:28:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:28:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:28:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:28:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:28:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:28:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:28:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Updating instance_info_cache with network_info: [{"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:28:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-7f3f3c5b-5128-4356-a995-fe3265f49fe1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:28:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:28:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:28:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:28:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:28:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "a799a142-e6f4-4027-9568-e99d2501ca8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:28:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:28:32 user nova-compute[75100]: INFO nova.compute.claims [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Claim successful on node user
Nov 13 17:28:32 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:28:32 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:28:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:28:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:28:33 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:28:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG nova.policy [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '421484d1f180498fa5e078c084d70986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bd8fd1a36f49a08be3d97799e847a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:28:33 user nova-compute[75100]: INFO nova.virt.block_device [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Booting with volume cae63b19-8572-4771-901c-07d61731cd22 at /dev/vda
Nov 13 17:28:33 user nova-compute[75100]: DEBUG os_brick.utils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fac18e-01de-4da7-87c1-30ef189a0ce7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[242cd2ed-7562-44ab-9476-f8418956ff49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8933b916-fd86-48f7-92f8-47d03b16aa6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db2465f-22e9-46c5-9391-0bdfa1337d95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:28:33 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:28:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c963e2-3843-46d5-a8cc-08cf959f4258]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG os_brick.utils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Updating existing volume attachment record: 4fcadfcf-921f-4bf3-a01a-d5e548f487b7 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:28:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Successfully created port: b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Successfully updated port: b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "refresh_cache-a799a142-e6f4-4027-9568-e99d2501ca8e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquired lock "refresh_cache-a799a142-e6f4-4027-9568-e99d2501ca8e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-0871c21d-742a-4a2a-88c5-6a7afc0243c1 req-c8b4e20e-d4f3-49cd-a35a-42f45b515030 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Received event network-changed-b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-0871c21d-742a-4a2a-88c5-6a7afc0243c1 req-c8b4e20e-d4f3-49cd-a35a-42f45b515030 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Refreshing instance network info cache due to event network-changed-b75de1fb-d048-4654-b394-76ccaedb6f34. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0871c21d-742a-4a2a-88c5-6a7afc0243c1 req-c8b4e20e-d4f3-49cd-a35a-42f45b515030 service nova] Acquiring lock "refresh_cache-a799a142-e6f4-4027-9568-e99d2501ca8e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Updating instance_info_cache with network_info: [{"id": "b75de1fb-d048-4654-b394-76ccaedb6f34", "address": "fa:16:3e:c8:61:ae", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75de1fb-d0", "ovs_interfaceid": "b75de1fb-d048-4654-b394-76ccaedb6f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Releasing lock "refresh_cache-a799a142-e6f4-4027-9568-e99d2501ca8e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Instance network_info: |[{"id": "b75de1fb-d048-4654-b394-76ccaedb6f34", "address": "fa:16:3e:c8:61:ae", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75de1fb-d0", "ovs_interfaceid": "b75de1fb-d048-4654-b394-76ccaedb6f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0871c21d-742a-4a2a-88c5-6a7afc0243c1 req-c8b4e20e-d4f3-49cd-a35a-42f45b515030 service nova] Acquired lock "refresh_cache-a799a142-e6f4-4027-9568-e99d2501ca8e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:28:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-0871c21d-742a-4a2a-88c5-6a7afc0243c1 req-c8b4e20e-d4f3-49cd-a35a-42f45b515030 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Refreshing network info cache for port b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:28:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-0871c21d-742a-4a2a-88c5-6a7afc0243c1 req-c8b4e20e-d4f3-49cd-a35a-42f45b515030 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Updated VIF entry in instance network info cache for port b75de1fb-d048-4654-b394-76ccaedb6f34. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:28:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-0871c21d-742a-4a2a-88c5-6a7afc0243c1 req-c8b4e20e-d4f3-49cd-a35a-42f45b515030 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Updating instance_info_cache with network_info: [{"id": "b75de1fb-d048-4654-b394-76ccaedb6f34", "address": "fa:16:3e:c8:61:ae", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75de1fb-d0", "ovs_interfaceid": "b75de1fb-d048-4654-b394-76ccaedb6f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:28:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0871c21d-742a-4a2a-88c5-6a7afc0243c1 req-c8b4e20e-d4f3-49cd-a35a-42f45b515030 service nova] Releasing lock "refresh_cache-a799a142-e6f4-4027-9568-e99d2501ca8e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:28:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Creating image(s)
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Ensure instance console log exists: /opt/stack/data/nova/instances/a799a142-e6f4-4027-9568-e99d2501ca8e/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Start _get_guest_xml network_info=[{"id": "b75de1fb-d048-4654-b394-76ccaedb6f34", "address": "fa:16:3e:c8:61:ae", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75de1fb-d0", "ovs_interfaceid": "b75de1fb-d048-4654-b394-76ccaedb6f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '4fcadfcf-921f-4bf3-a01a-d5e548f487b7', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJYlfmHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a799a142-e6f4-4027-9568-e99d2501ca8e', 'attached_at': '', 'detached_at': '', 'volume_id': 'cae63b19-8572-4771-901c-07d61731cd22', 'serial': 'cae63b19-8572-4771-901c-07d61731cd22'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:28:37 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:28:37 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJYlfmHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:28:37 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:28:37 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:28:37 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d1859e-96e2-46df-a4cc-5e423fbd37fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:28:37 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a04fe88-41fd-48da-b90e-f2b8b6265710]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22] added
Nov 13 17:28:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad73e957-fa3e-4733-aa0a-edd518616767]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[593fda85-3a87-40be-890e-1e7e3fbb0d0f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJYlfmHU {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJYlfmHU" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a9f028-cb29-4e1c-9adf-1cd498b1fdd5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJYlfmHU'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36426f2-6bd2-4aaf-b990-66f7ba42e10e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e524c859-88d6-4be4-b26e-633440186f95]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:37 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:37 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c36b38d-e195-49c3-a205-36a4fb90f32d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260]
Nov 13 17:28:37 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260] successful.
Nov 13 17:28:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6520b3fc-b649-4cdd-bc84-069a9ea10be8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[258f76b2-1b47-4bdf-b190-474e9610b98f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:37 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:37 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:28:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:37 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:37 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:28:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[875cd1b4-9682-4f93-a9b5-c5897e8c6435]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJYlfmHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:28:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23731353363643863', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731353363643863', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-956110543',display_name='tempest-TestVolumeBootPattern-server-956110543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-956110543',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+NtN2Z5kT0TQJbfKGQsJyKiPak8bepWgNcLUPGujC+AXoGWK840LLNYNacMdPigyvVLHhv89mM2IBFpbgvf3ZqImVEZSa6YyJUnBkkWfhyP+tfJPZtUfdOTGbNpjZ7sA==',key_name='tempest-TestVolumeBootPattern-2052596683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-0eq7pew1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:28:33Z,user_data=None,user_id='421484d1f180498fa5e078c084d70986',uuid=a799a142-e6f4-4027-9568-e99d2501ca8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b75de1fb-d048-4654-b394-76ccaedb6f34", "address": "fa:16:3e:c8:61:ae", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75de1fb-d0", "ovs_interfaceid": "b75de1fb-d048-4654-b394-76ccaedb6f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "b75de1fb-d048-4654-b394-76ccaedb6f34", "address": "fa:16:3e:c8:61:ae", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75de1fb-d0", "ovs_interfaceid": "b75de1fb-d048-4654-b394-76ccaedb6f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:61:ae,bridge_name='br-int',has_traffic_filtering=True,id=b75de1fb-d048-4654-b394-76ccaedb6f34,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75de1fb-d0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG nova.objects.instance [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lazy-loading 'pci_devices' on Instance uuid a799a142-e6f4-4027-9568-e99d2501ca8e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:28:38 user nova-compute[75100]:   <uuid>a799a142-e6f4-4027-9568-e99d2501ca8e</uuid>
Nov 13 17:28:38 user nova-compute[75100]:   <name>instance-0000001a</name>
Nov 13 17:28:38 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:28:38 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:28:38 user nova-compute[75100]:   <metadata>
Nov 13 17:28:38 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:28:38 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:28:38 user nova-compute[75100]:       <nova:name>tempest-TestVolumeBootPattern-server-956110543</nova:name>
Nov 13 17:28:38 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:28:37</nova:creationTime>
Nov 13 17:28:38 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:28:38 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:28:38 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:28:38 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:28:38 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:28:38 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:28:38 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:28:38 user nova-compute[75100]:       <nova:owner>
Nov 13 17:28:38 user nova-compute[75100]:         <nova:user uuid="421484d1f180498fa5e078c084d70986">tempest-TestVolumeBootPattern-1156978750-project-member</nova:user>
Nov 13 17:28:38 user nova-compute[75100]:         <nova:project uuid="20bd8fd1a36f49a08be3d97799e847a8">tempest-TestVolumeBootPattern-1156978750</nova:project>
Nov 13 17:28:38 user nova-compute[75100]:       </nova:owner>
Nov 13 17:28:38 user nova-compute[75100]:       <nova:ports>
Nov 13 17:28:38 user nova-compute[75100]:         <nova:port uuid="b75de1fb-d048-4654-b394-76ccaedb6f34">
Nov 13 17:28:38 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 17:28:38 user nova-compute[75100]:         </nova:port>
Nov 13 17:28:38 user nova-compute[75100]:       </nova:ports>
Nov 13 17:28:38 user nova-compute[75100]:     </nova:instance>
Nov 13 17:28:38 user nova-compute[75100]:   </metadata>
Nov 13 17:28:38 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:28:38 user nova-compute[75100]:     <system>
Nov 13 17:28:38 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:28:38 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:28:38 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:28:38 user nova-compute[75100]:       <entry name="serial">a799a142-e6f4-4027-9568-e99d2501ca8e</entry>
Nov 13 17:28:38 user nova-compute[75100]:       <entry name="uuid">a799a142-e6f4-4027-9568-e99d2501ca8e</entry>
Nov 13 17:28:38 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:28:38 user nova-compute[75100]:     </system>
Nov 13 17:28:38 user nova-compute[75100]:   </sysinfo>
Nov 13 17:28:38 user nova-compute[75100]:   <os>
Nov 13 17:28:38 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:28:38 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:28:38 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:28:38 user nova-compute[75100]:   </os>
Nov 13 17:28:38 user nova-compute[75100]:   <features>
Nov 13 17:28:38 user nova-compute[75100]:     <acpi/>
Nov 13 17:28:38 user nova-compute[75100]:     <apic/>
Nov 13 17:28:38 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:28:38 user nova-compute[75100]:   </features>
Nov 13 17:28:38 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:28:38 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:28:38 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:28:38 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:28:38 user nova-compute[75100]:   </clock>
Nov 13 17:28:38 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:28:38 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:28:38 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:28:38 user nova-compute[75100]:   </cpu>
Nov 13 17:28:38 user nova-compute[75100]:   <devices>
Nov 13 17:28:38 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:28:38 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:28:38 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 13 17:28:38 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:28:38 user nova-compute[75100]:       <serial>cae63b19-8572-4771-901c-07d61731cd22</serial>
Nov 13 17:28:38 user nova-compute[75100]:     </disk>
Nov 13 17:28:38 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:28:38 user nova-compute[75100]:       <mac address="fa:16:3e:c8:61:ae"/>
Nov 13 17:28:38 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:28:38 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:28:38 user nova-compute[75100]:       <target dev="tapb75de1fb-d0"/>
Nov 13 17:28:38 user nova-compute[75100]:     </interface>
Nov 13 17:28:38 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:28:38 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/a799a142-e6f4-4027-9568-e99d2501ca8e/console.log" append="off"/>
Nov 13 17:28:38 user nova-compute[75100]:     </serial>
Nov 13 17:28:38 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:28:38 user nova-compute[75100]:     <video>
Nov 13 17:28:38 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:28:38 user nova-compute[75100]:     </video>
Nov 13 17:28:38 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:28:38 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:28:38 user nova-compute[75100]:     </rng>
Nov 13 17:28:38 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:28:38 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:28:38 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:28:38 user nova-compute[75100]:     </memballoon>
Nov 13 17:28:38 user nova-compute[75100]:   </devices>
Nov 13 17:28:38 user nova-compute[75100]: </domain>
Nov 13 17:28:38 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-956110543',display_name='tempest-TestVolumeBootPattern-server-956110543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-956110543',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+NtN2Z5kT0TQJbfKGQsJyKiPak8bepWgNcLUPGujC+AXoGWK840LLNYNacMdPigyvVLHhv89mM2IBFpbgvf3ZqImVEZSa6YyJUnBkkWfhyP+tfJPZtUfdOTGbNpjZ7sA==',key_name='tempest-TestVolumeBootPattern-2052596683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-0eq7pew1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:28:33Z,user_data=None,user_id='421484d1f180498fa5e078c084d70986',uuid=a799a142-e6f4-4027-9568-e99d2501ca8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b75de1fb-d048-4654-b394-76ccaedb6f34", "address": "fa:16:3e:c8:61:ae", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75de1fb-d0", "ovs_interfaceid": "b75de1fb-d048-4654-b394-76ccaedb6f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "b75de1fb-d048-4654-b394-76ccaedb6f34", "address": "fa:16:3e:c8:61:ae", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75de1fb-d0", "ovs_interfaceid": "b75de1fb-d048-4654-b394-76ccaedb6f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:61:ae,bridge_name='br-int',has_traffic_filtering=True,id=b75de1fb-d048-4654-b394-76ccaedb6f34,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75de1fb-d0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG os_vif [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:61:ae,bridge_name='br-int',has_traffic_filtering=True,id=b75de1fb-d048-4654-b394-76ccaedb6f34,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75de1fb-d0') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c348337-fbd0-5275-b9f8-5ec5359abb98', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb75de1fb-d0, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb75de1fb-d0, col_values=(('qos', UUID('60515381-2d0e-49c9-844d-07c6b5a17c3b')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb75de1fb-d0, col_values=(('external_ids', {'iface-id': 'b75de1fb-d048-4654-b394-76ccaedb6f34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:61:ae', 'vm-uuid': 'a799a142-e6f4-4027-9568-e99d2501ca8e'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:28:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:39 user nova-compute[75100]: INFO os_vif [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:61:ae,bridge_name='br-int',has_traffic_filtering=True,id=b75de1fb-d048-4654-b394-76ccaedb6f34,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75de1fb-d0')
Nov 13 17:28:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:28:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] No VIF found with MAC fa:16:3e:c8:61:ae, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:28:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-809acca0-0187-4127-926a-61227f291982 req-c99438ea-48c0-49e1-bd83-ac3541ca1aaa service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Received event network-vif-plugged-b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-809acca0-0187-4127-926a-61227f291982 req-c99438ea-48c0-49e1-bd83-ac3541ca1aaa service nova] Acquiring lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-809acca0-0187-4127-926a-61227f291982 req-c99438ea-48c0-49e1-bd83-ac3541ca1aaa service nova] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-809acca0-0187-4127-926a-61227f291982 req-c99438ea-48c0-49e1-bd83-ac3541ca1aaa service nova] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-809acca0-0187-4127-926a-61227f291982 req-c99438ea-48c0-49e1-bd83-ac3541ca1aaa service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] No waiting events found dispatching network-vif-plugged-b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:28:40 user nova-compute[75100]: WARNING nova.compute.manager [req-809acca0-0187-4127-926a-61227f291982 req-c99438ea-48c0-49e1-bd83-ac3541ca1aaa service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Received unexpected event network-vif-plugged-b75de1fb-d048-4654-b394-76ccaedb6f34 for instance with vm_state building and task_state spawning.
Nov 13 17:28:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:28:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Instance spawned successfully.
Nov 13 17:28:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:28:42 user nova-compute[75100]: INFO nova.compute.manager [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 13 17:28:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-9b6dd67e-d0c0-4dbe-b135-deaf54c39473 req-d7b6ff3a-1246-4810-a37a-2c6faee7ca23 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Received event network-vif-plugged-b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9b6dd67e-d0c0-4dbe-b135-deaf54c39473 req-d7b6ff3a-1246-4810-a37a-2c6faee7ca23 service nova] Acquiring lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9b6dd67e-d0c0-4dbe-b135-deaf54c39473 req-d7b6ff3a-1246-4810-a37a-2c6faee7ca23 service nova] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9b6dd67e-d0c0-4dbe-b135-deaf54c39473 req-d7b6ff3a-1246-4810-a37a-2c6faee7ca23 service nova] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-9b6dd67e-d0c0-4dbe-b135-deaf54c39473 req-d7b6ff3a-1246-4810-a37a-2c6faee7ca23 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] No waiting events found dispatching network-vif-plugged-b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:28:42 user nova-compute[75100]: WARNING nova.compute.manager [req-9b6dd67e-d0c0-4dbe-b135-deaf54c39473 req-d7b6ff3a-1246-4810-a37a-2c6faee7ca23 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Received unexpected event network-vif-plugged-b75de1fb-d048-4654-b394-76ccaedb6f34 for instance with vm_state building and task_state spawning.
Nov 13 17:28:42 user nova-compute[75100]: INFO nova.compute.manager [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Took 10.20 seconds to build instance.
Nov 13 17:28:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-512cc2f2-ecca-4a46-b905-3636d6ead71c tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.320s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'flavor' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:44 user nova-compute[75100]: INFO nova.compute.manager [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attaching volume ebdee040-c906-4d28-bcec-9ea038e9578d to /dev/vdb
Nov 13 17:28:44 user nova-compute[75100]: DEBUG os_brick.utils [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa44f00d-ac65-4f13-bbc2-669121b3ee62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb3ff85-d689-41d3-85d9-861b61099c06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba7bd91-dc10-41c4-81bb-c9be2d2718b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5d57f1-0eba-4142-854e-b3dc47f1f01f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:28:44 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:28:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49de2a3-b913-4fa0-8905-d312e8afe410]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG os_brick.utils [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:28:44 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Updating existing volume attachment record: 7a4a570f-858e-49aa-a56f-50943174f36d {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:28:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDksACiZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:28:48 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:28:48 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:28:48 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[22554c0a-9902-4e6e-bce8-00ad5e7d620b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:28:48 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[126ce1b8-4076-4ce6-8257-5f27d75b33a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d] added
Nov 13 17:28:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00c9fc6-0f9d-42cb-bdba-3a6eee49c1a1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0004b6ea-fa49-47b0-9b6e-a4f41e6eb95f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aDksACiZ {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aDksACiZ" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d5e1e9-b53a-4038-bd1e-5a0aaf2c21f2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aDksACiZ'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a419cac-60f0-4176-af20-0a994873af74]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[984c705e-11b9-4ff6-8f04-49365336320a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:48 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:48 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:28:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:48 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:48 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:28:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd139378-0e60-4830-b5f8-d80eb3aacbee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d, portal: 172.16.0.220,3260]
Nov 13 17:28:48 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d, portal: 172.16.0.220,3260] successful.
Nov 13 17:28:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f8232c-76a0-4f44-99a8-05015e2d4e66]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f5c008-a93e-4a29-9ee7-59cdcdec8f70]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:48 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:48 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:28:48 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d (non-flash)
Nov 13 17:28:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:28:48 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:28:48 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:28:48 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d (non-flash)
Nov 13 17:28:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08c38d0-7490-4e95-8554-e4231c0b5a4a]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:28:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:28:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:28:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDksACiZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:28:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:28:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23634316635646439', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:28:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634316635646439', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:28:49 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'flavor' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:28:50 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:28:50 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 13 17:28:50 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:28:50 user nova-compute[75100]:   <serial>ebdee040-c906-4d28-bcec-9ea038e9578d</serial>
Nov 13 17:28:50 user nova-compute[75100]: </disk>
Nov 13 17:28:50 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:28:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:28:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:28:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No VIF found with MAC fa:16:3e:0b:72:c0, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:28:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb811133-d21a-4816-b0ef-46474db9ff92 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.123s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:52 user nova-compute[75100]: INFO nova.compute.manager [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Detaching volume ebdee040-c906-4d28-bcec-9ea038e9578d
Nov 13 17:28:52 user nova-compute[75100]: INFO nova.virt.block_device [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attempting to driver detach volume ebdee040-c906-4d28-bcec-9ea038e9578d from mountpoint /dev/vdb
Nov 13 17:28:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Attempting to detach device vdb from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:28:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:28:52 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:28:52 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 13 17:28:52 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:28:52 user nova-compute[75100]:   <serial>ebdee040-c906-4d28-bcec-9ea038e9578d</serial>
Nov 13 17:28:52 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:28:52 user nova-compute[75100]: </disk>
Nov 13 17:28:52 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:28:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Successfully detached device vdb from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the persistent domain config.
Nov 13 17:28:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:28:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:28:52 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:28:52 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 13 17:28:52 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:28:52 user nova-compute[75100]:   <serial>ebdee040-c906-4d28-bcec-9ea038e9578d</serial>
Nov 13 17:28:52 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:28:52 user nova-compute[75100]: </disk>
Nov 13 17:28:52 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:28:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:28:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:56 user nova-compute[75100]: INFO nova.compute.manager [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Terminating instance
Nov 13 17:28:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:28:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-c3ce374e-c057-406d-bccd-75dccf28c5dd req-f029e2b5-2aec-48e6-9de9-4ad15b34efef service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received event network-vif-unplugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c3ce374e-c057-406d-bccd-75dccf28c5dd req-f029e2b5-2aec-48e6-9de9-4ad15b34efef service nova] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c3ce374e-c057-406d-bccd-75dccf28c5dd req-f029e2b5-2aec-48e6-9de9-4ad15b34efef service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c3ce374e-c057-406d-bccd-75dccf28c5dd req-f029e2b5-2aec-48e6-9de9-4ad15b34efef service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-c3ce374e-c057-406d-bccd-75dccf28c5dd req-f029e2b5-2aec-48e6-9de9-4ad15b34efef service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] No waiting events found dispatching network-vif-unplugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-c3ce374e-c057-406d-bccd-75dccf28c5dd req-f029e2b5-2aec-48e6-9de9-4ad15b34efef service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received event network-vif-unplugged-f3f52df4-25c5-4c98-9a0c-76093617c180 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Instance destroyed successfully.
Nov 13 17:28:57 user nova-compute[75100]: DEBUG nova.objects.instance [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lazy-loading 'resources' on Instance uuid 5933add2-b8bb-448d-a054-d8527e3c49f8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:23:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-33132177',display_name='tempest-ServerActionsTestOtherA-server-1631903817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-33132177',id=15,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbFY5LgKRXl7mG8F4M+9+fbhr2HSsopYQvyoxkqIHaLSDggJc3195H3FH3yXGej6QMVhX0ugpcyjD2elnXP0l/zvIcBGJ/8nBKUf7xPxcXKw5IKnnG2QtFINn4u/nqf7w==',key_name='tempest-keypair-558257575',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:25:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-8y9r17uo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:25:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=5933add2-b8bb-448d-a054-d8527e3c49f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "f3f52df4-25c5-4c98-9a0c-76093617c180", "address": "fa:16:3e:d4:ef:78", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3f52df4-25", "ovs_interfaceid": "f3f52df4-25c5-4c98-9a0c-76093617c180", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG os_vif [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3f52df4-25, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=413dfae8-5aa3-4edb-9c07-6dceb6beee08) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:28:57 user nova-compute[75100]: INFO os_vif [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:ef:78,bridge_name='br-int',has_traffic_filtering=True,id=f3f52df4-25c5-4c98-9a0c-76093617c180,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3f52df4-25')
Nov 13 17:28:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Deleting instance files /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8_del
Nov 13 17:28:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Deletion of /opt/stack/data/nova/instances/5933add2-b8bb-448d-a054-d8527e3c49f8_del complete
Nov 13 17:28:57 user nova-compute[75100]: INFO nova.compute.manager [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 13 17:28:57 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:28:57 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:28:58 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:28:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-c1b1b037-9b43-4335-a810-931b98e6dd26 req-1ee13ac0-e6ad-4126-9639-803954f535df service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received event network-vif-deleted-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:58 user nova-compute[75100]: INFO nova.compute.manager [req-c1b1b037-9b43-4335-a810-931b98e6dd26 req-1ee13ac0-e6ad-4126-9639-803954f535df service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Neutron deleted interface f3f52df4-25c5-4c98-9a0c-76093617c180; detaching it from the instance and deleting it from the info cache
Nov 13 17:28:58 user nova-compute[75100]: DEBUG nova.network.neutron [req-c1b1b037-9b43-4335-a810-931b98e6dd26 req-1ee13ac0-e6ad-4126-9639-803954f535df service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:28:58 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Took 0.67 seconds to deallocate network for instance.
Nov 13 17:28:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-c1b1b037-9b43-4335-a810-931b98e6dd26 req-1ee13ac0-e6ad-4126-9639-803954f535df service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Detach interface failed, port_id=f3f52df4-25c5-4c98-9a0c-76093617c180, reason: Instance 5933add2-b8bb-448d-a054-d8527e3c49f8 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:28:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:58 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:28:58 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:28:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:58 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Deleted allocations for instance 5933add2-b8bb-448d-a054-d8527e3c49f8
Nov 13 17:28:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-64b51e67-3ee6-416c-8c47-abb9f44d6530 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.163s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-34118be3-9094-479d-8eae-506fd3c6c034 req-7ce80782-3174-4432-ada5-3fadb1561838 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received event network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:28:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34118be3-9094-479d-8eae-506fd3c6c034 req-7ce80782-3174-4432-ada5-3fadb1561838 service nova] Acquiring lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:28:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34118be3-9094-479d-8eae-506fd3c6c034 req-7ce80782-3174-4432-ada5-3fadb1561838 service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:28:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-34118be3-9094-479d-8eae-506fd3c6c034 req-7ce80782-3174-4432-ada5-3fadb1561838 service nova] Lock "5933add2-b8bb-448d-a054-d8527e3c49f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:28:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-34118be3-9094-479d-8eae-506fd3c6c034 req-7ce80782-3174-4432-ada5-3fadb1561838 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] No waiting events found dispatching network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:28:59 user nova-compute[75100]: WARNING nova.compute.manager [req-34118be3-9094-479d-8eae-506fd3c6c034 req-7ce80782-3174-4432-ada5-3fadb1561838 service nova] [instance: 5933add2-b8bb-448d-a054-d8527e3c49f8] Received unexpected event network-vif-plugged-f3f52df4-25c5-4c98-9a0c-76093617c180 for instance with vm_state deleted and task_state None.
Nov 13 17:29:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:29:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:10 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:29:10 user nova-compute[75100]: INFO nova.compute.claims [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Claim successful on node user
Nov 13 17:29:11 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG nova.network.neutron [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:29:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:29:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG nova.policy [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39ea90d2812646af874d709df2efe59e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb93f95f4f604b9f99a2c9a6fdc96ae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG nova.compute.manager [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:29:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Creating image(s)
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "/opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "/opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk 1073741824" returned: 0 in 0.056s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Successfully created port: 0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Cannot resize image /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Ensure instance console log exists: /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Successfully updated port: 0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquired lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-3b83be4e-446f-48a3-8965-1756ebb140fd req-240a5aea-aa77-4777-a725-4aa3cde3d120 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-changed-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-3b83be4e-446f-48a3-8965-1756ebb140fd req-240a5aea-aa77-4777-a725-4aa3cde3d120 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Refreshing instance network info cache due to event network-changed-0e4ff1c7-53c8-45ff-818e-03d897b1e954. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3b83be4e-446f-48a3-8965-1756ebb140fd req-240a5aea-aa77-4777-a725-4aa3cde3d120 service nova] Acquiring lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:29:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:29:13 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a is timed out.
Nov 13 17:29:13 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Successfully detached device vdb from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the live domain config.
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDksACiZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:29:13 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[570adac3-c6b2-4b99-8eea-0089de437c95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:29:13 user nova-compute[75100]: No targets found.
Nov 13 17:29:13 user nova-compute[75100]: iSNS:
Nov 13 17:29:13 user nova-compute[75100]: No targets found.
Nov 13 17:29:13 user nova-compute[75100]: STATIC:
Nov 13 17:29:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:29:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:29:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:29:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d
Nov 13 17:29:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:29:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:29:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22
Nov 13 17:29:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:29:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:29:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12
Nov 13 17:29:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:29:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:29:13 user nova-compute[75100]: FIRMWARE:
Nov 13 17:29:13 user nova-compute[75100]: No targets found.
Nov 13 17:29:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:29:13 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:29:13 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6079a414-191e-4e88-b986-ebe90fae7b80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c950568-8c01-4f81-877d-d462318ad100]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:29:13 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:29:13 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:29:13 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d (non-flash)
Nov 13 17:29:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:29:13 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:29:13 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:29:13 user nova-compute[75100]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d (non-flash)
Nov 13 17:29:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38b30550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[18014426-ffdf-4bb1-9c39-2891ffa24d37]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6e4fb7-3628-4da1-90a5-2674dab5d630]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e566fd-1d6f-4732-87f2-736360d0a0a8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ecc955c-3bc7-415e-8977-d5d6b28eee17]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[afedb175-bcb3-44aa-8e15-c776038fafdf]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.network.neutron [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updating instance_info_cache with network_info: [{"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Releasing lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.compute.manager [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Instance network_info: |[{"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3b83be4e-446f-48a3-8965-1756ebb140fd req-240a5aea-aa77-4777-a725-4aa3cde3d120 service nova] Acquired lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.network.neutron [req-3b83be4e-446f-48a3-8965-1756ebb140fd req-240a5aea-aa77-4777-a725-4aa3cde3d120 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Refreshing network info cache for port 0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Start _get_guest_xml network_info=[{"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d8c81e-79ee-4de5-b6a8-c711a78b7860]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d, portal: 172.16.0.220,3260]
Nov 13 17:29:13 user nova-compute[75100]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d, portal: 172.16.0.220,3260] successful.
Nov 13 17:29:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:13 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:29:13 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-234989406',display_name='tempest-ServerStableDeviceRescueTest-server-234989406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-234989406',id=27,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTMZqt3AhpfLX/zImDo+vtV1+wrh9vw8+PaC+kdhYPk4LTG5ahylEV0Kp0Dh27kGA7KM8ig1B7ReH+DTmuQb6ye8DfVW79pPWGcZ5HGnRrkbDfk2JwiCFo2IeHoktdACQ==',key_name='tempest-keypair-831100549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb93f95f4f604b9f99a2c9a6fdc96ae8',ramdisk_id='',reservation_id='r-yclingnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-766369628',owner_user_name='tempest-ServerStableDeviceRescueTest-766369628-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ea90d2812646af874d709df2efe59e',uuid=2f5b57a9-5bac-4275-a51a-3213d7f9414f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Converting VIF {"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ef:0d,bridge_name='br-int',has_traffic_filtering=True,id=0e4ff1c7-53c8-45ff-818e-03d897b1e954,network=Network(6322d48b-3e6b-499b-a809-69289dee5119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4ff1c7-53') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdee040-c906-4d28-bcec-9ea038e9578d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74f849a-0f21-4f13-8309-097782cdfba5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] <== disconnect_volume: return (376ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:29:13 user nova-compute[75100]:   <uuid>2f5b57a9-5bac-4275-a51a-3213d7f9414f</uuid>
Nov 13 17:29:13 user nova-compute[75100]:   <name>instance-0000001b</name>
Nov 13 17:29:13 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:29:13 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:29:13 user nova-compute[75100]:   <metadata>
Nov 13 17:29:13 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:29:13 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:29:13 user nova-compute[75100]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-234989406</nova:name>
Nov 13 17:29:13 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:29:13</nova:creationTime>
Nov 13 17:29:13 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:29:13 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:29:13 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:29:13 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:29:13 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:29:13 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:29:13 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:29:13 user nova-compute[75100]:       <nova:owner>
Nov 13 17:29:13 user nova-compute[75100]:         <nova:user uuid="39ea90d2812646af874d709df2efe59e">tempest-ServerStableDeviceRescueTest-766369628-project-member</nova:user>
Nov 13 17:29:13 user nova-compute[75100]:         <nova:project uuid="cb93f95f4f604b9f99a2c9a6fdc96ae8">tempest-ServerStableDeviceRescueTest-766369628</nova:project>
Nov 13 17:29:13 user nova-compute[75100]:       </nova:owner>
Nov 13 17:29:13 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:29:13 user nova-compute[75100]:       <nova:ports>
Nov 13 17:29:13 user nova-compute[75100]:         <nova:port uuid="0e4ff1c7-53c8-45ff-818e-03d897b1e954">
Nov 13 17:29:13 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:29:13 user nova-compute[75100]:         </nova:port>
Nov 13 17:29:13 user nova-compute[75100]:       </nova:ports>
Nov 13 17:29:13 user nova-compute[75100]:     </nova:instance>
Nov 13 17:29:13 user nova-compute[75100]:   </metadata>
Nov 13 17:29:13 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:29:13 user nova-compute[75100]:     <system>
Nov 13 17:29:13 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:29:13 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:29:13 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:29:13 user nova-compute[75100]:       <entry name="serial">2f5b57a9-5bac-4275-a51a-3213d7f9414f</entry>
Nov 13 17:29:13 user nova-compute[75100]:       <entry name="uuid">2f5b57a9-5bac-4275-a51a-3213d7f9414f</entry>
Nov 13 17:29:13 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:29:13 user nova-compute[75100]:     </system>
Nov 13 17:29:13 user nova-compute[75100]:   </sysinfo>
Nov 13 17:29:13 user nova-compute[75100]:   <os>
Nov 13 17:29:13 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:29:13 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:29:13 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:29:13 user nova-compute[75100]:   </os>
Nov 13 17:29:13 user nova-compute[75100]:   <features>
Nov 13 17:29:13 user nova-compute[75100]:     <acpi/>
Nov 13 17:29:13 user nova-compute[75100]:     <apic/>
Nov 13 17:29:13 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:29:13 user nova-compute[75100]:   </features>
Nov 13 17:29:13 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:29:13 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:29:13 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:29:13 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:29:13 user nova-compute[75100]:   </clock>
Nov 13 17:29:13 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:29:13 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:29:13 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:29:13 user nova-compute[75100]:   </cpu>
Nov 13 17:29:13 user nova-compute[75100]:   <devices>
Nov 13 17:29:13 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:29:13 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:29:13 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk"/>
Nov 13 17:29:13 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:29:13 user nova-compute[75100]:     </disk>
Nov 13 17:29:13 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:29:13 user nova-compute[75100]:       <mac address="fa:16:3e:da:ef:0d"/>
Nov 13 17:29:13 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:29:13 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:29:13 user nova-compute[75100]:       <target dev="tap0e4ff1c7-53"/>
Nov 13 17:29:13 user nova-compute[75100]:     </interface>
Nov 13 17:29:13 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:29:13 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/console.log" append="off"/>
Nov 13 17:29:13 user nova-compute[75100]:     </serial>
Nov 13 17:29:13 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:29:13 user nova-compute[75100]:     <video>
Nov 13 17:29:13 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:29:13 user nova-compute[75100]:     </video>
Nov 13 17:29:13 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:29:13 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:29:13 user nova-compute[75100]:     </rng>
Nov 13 17:29:13 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:29:13 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:29:13 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:29:13 user nova-compute[75100]:     </memballoon>
Nov 13 17:29:13 user nova-compute[75100]:   </devices>
Nov 13 17:29:13 user nova-compute[75100]: </domain>
Nov 13 17:29:13 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-234989406',display_name='tempest-ServerStableDeviceRescueTest-server-234989406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-234989406',id=27,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTMZqt3AhpfLX/zImDo+vtV1+wrh9vw8+PaC+kdhYPk4LTG5ahylEV0Kp0Dh27kGA7KM8ig1B7ReH+DTmuQb6ye8DfVW79pPWGcZ5HGnRrkbDfk2JwiCFo2IeHoktdACQ==',key_name='tempest-keypair-831100549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb93f95f4f604b9f99a2c9a6fdc96ae8',ramdisk_id='',reservation_id='r-yclingnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-766369628',owner_user_name='tempest-ServerStableDeviceRescueTest-766369628-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:29:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ea90d2812646af874d709df2efe59e',uuid=2f5b57a9-5bac-4275-a51a-3213d7f9414f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Converting VIF {"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ef:0d,bridge_name='br-int',has_traffic_filtering=True,id=0e4ff1c7-53c8-45ff-818e-03d897b1e954,network=Network(6322d48b-3e6b-499b-a809-69289dee5119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4ff1c7-53') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG os_vif [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ef:0d,bridge_name='br-int',has_traffic_filtering=True,id=0e4ff1c7-53c8-45ff-818e-03d897b1e954,network=Network(6322d48b-3e6b-499b-a809-69289dee5119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4ff1c7-53') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35b26d13-6a4b-5a2c-a508-069027451398', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e4ff1c7-53, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e4ff1c7-53, col_values=(('qos', UUID('7dbac6e0-c329-4956-ab11-aa228ed948cd')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e4ff1c7-53, col_values=(('external_ids', {'iface-id': '0e4ff1c7-53c8-45ff-818e-03d897b1e954', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:ef:0d', 'vm-uuid': '2f5b57a9-5bac-4275-a51a-3213d7f9414f'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:13 user nova-compute[75100]: INFO os_vif [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ef:0d,bridge_name='br-int',has_traffic_filtering=True,id=0e4ff1c7-53c8-45ff-818e-03d897b1e954,network=Network(6322d48b-3e6b-499b-a809-69289dee5119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4ff1c7-53')
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] No VIF found with MAC fa:16:3e:da:ef:0d, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.network.neutron [req-3b83be4e-446f-48a3-8965-1756ebb140fd req-240a5aea-aa77-4777-a725-4aa3cde3d120 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updated VIF entry in instance network info cache for port 0e4ff1c7-53c8-45ff-818e-03d897b1e954. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG nova.network.neutron [req-3b83be4e-446f-48a3-8965-1756ebb140fd req-240a5aea-aa77-4777-a725-4aa3cde3d120 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updating instance_info_cache with network_info: [{"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:29:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3b83be4e-446f-48a3-8965-1756ebb140fd req-240a5aea-aa77-4777-a725-4aa3cde3d120 service nova] Releasing lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:14 user nova-compute[75100]: INFO nova.compute.manager [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Terminating instance
Nov 13 17:29:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG nova.objects.instance [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'flavor' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-333bf2ff-9430-4ae8-988e-66cbbe72d6b3 tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.816s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-0300614a-f1bf-41d2-a01e-d900c7bfd167 req-e7c416eb-74fe-4a21-b9a0-bf17b8d53e48 service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Received event network-vif-unplugged-311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0300614a-f1bf-41d2-a01e-d900c7bfd167 req-e7c416eb-74fe-4a21-b9a0-bf17b8d53e48 service nova] Acquiring lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0300614a-f1bf-41d2-a01e-d900c7bfd167 req-e7c416eb-74fe-4a21-b9a0-bf17b8d53e48 service nova] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0300614a-f1bf-41d2-a01e-d900c7bfd167 req-e7c416eb-74fe-4a21-b9a0-bf17b8d53e48 service nova] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-0300614a-f1bf-41d2-a01e-d900c7bfd167 req-e7c416eb-74fe-4a21-b9a0-bf17b8d53e48 service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] No waiting events found dispatching network-vif-unplugged-311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-0300614a-f1bf-41d2-a01e-d900c7bfd167 req-e7c416eb-74fe-4a21-b9a0-bf17b8d53e48 service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Received event network-vif-unplugged-311b11cf-67e8-42ac-9166-8b24a7fb5238 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-89567289-9b1a-471a-893e-702908cf9739 req-c2fedf75-bee1-4132-be72-13a17da9d58f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-89567289-9b1a-471a-893e-702908cf9739 req-c2fedf75-bee1-4132-be72-13a17da9d58f service nova] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-89567289-9b1a-471a-893e-702908cf9739 req-c2fedf75-bee1-4132-be72-13a17da9d58f service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-89567289-9b1a-471a-893e-702908cf9739 req-c2fedf75-bee1-4132-be72-13a17da9d58f service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-89567289-9b1a-471a-893e-702908cf9739 req-c2fedf75-bee1-4132-be72-13a17da9d58f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] No waiting events found dispatching network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:29:15 user nova-compute[75100]: WARNING nova.compute.manager [req-89567289-9b1a-471a-893e-702908cf9739 req-c2fedf75-bee1-4132-be72-13a17da9d58f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received unexpected event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 for instance with vm_state building and task_state spawning.
Nov 13 17:29:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Instance destroyed successfully.
Nov 13 17:29:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lazy-loading 'resources' on Instance uuid e96eb705-85e2-4cce-a91d-5d319b1b5083 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:23:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-97358362',display_name='tempest-VolumesAdminNegativeTest-server-97358362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-97358362',id=16,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHL5a3YI/CmgPPsCouyA7NlKHC1NxiJh4anyfyDfNM56tkGOuMF5kazL4+p4HvT67Cj6W+UKd9dcj5/H46LjJnoFW3gMemNJKGHup0QqcQdLuriHrmxBnSD1H2EDil82Kg==',key_name='tempest-keypair-65749873',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6052793c6f6e40ce9f63a04a0afd609f',ramdisk_id='',reservation_id='r-4mnmvr6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-57814532',owner_user_name='tempest-VolumesAdminNegativeTest-57814532-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4bb17b2fc6a4406ca5c476d267ff6f2a',uuid=e96eb705-85e2-4cce-a91d-5d319b1b5083,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "address": "fa:16:3e:d0:59:f9", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap311b11cf-67", "ovs_interfaceid": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Converting VIF {"id": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "address": "fa:16:3e:d0:59:f9", "network": {"id": "94fb8c60-94b4-4974-860d-f58475222921", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-806172934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6052793c6f6e40ce9f63a04a0afd609f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap311b11cf-67", "ovs_interfaceid": "311b11cf-67e8-42ac-9166-8b24a7fb5238", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:59:f9,bridge_name='br-int',has_traffic_filtering=True,id=311b11cf-67e8-42ac-9166-8b24a7fb5238,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap311b11cf-67') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG os_vif [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:59:f9,bridge_name='br-int',has_traffic_filtering=True,id=311b11cf-67e8-42ac-9166-8b24a7fb5238,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap311b11cf-67') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap311b11cf-67, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ccd6aec-78e9-4cc3-bb2b-588a423f209f) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:15 user nova-compute[75100]: INFO os_vif [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:59:f9,bridge_name='br-int',has_traffic_filtering=True,id=311b11cf-67e8-42ac-9166-8b24a7fb5238,network=Network(94fb8c60-94b4-4974-860d-f58475222921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap311b11cf-67')
Nov 13 17:29:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Deleting instance files /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083_del
Nov 13 17:29:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Deletion of /opt/stack/data/nova/instances/e96eb705-85e2-4cce-a91d-5d319b1b5083_del complete
Nov 13 17:29:15 user nova-compute[75100]: INFO nova.compute.manager [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 13 17:29:15 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:29:15 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:29:16 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:29:16 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Took 0.68 seconds to deallocate network for instance.
Nov 13 17:29:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-a80ad910-4eca-4b32-b445-f1f65b476da7 req-29c2d635-7780-417e-bbf9-118e6317884f service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Received event network-vif-plugged-311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a80ad910-4eca-4b32-b445-f1f65b476da7 req-29c2d635-7780-417e-bbf9-118e6317884f service nova] Acquiring lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a80ad910-4eca-4b32-b445-f1f65b476da7 req-29c2d635-7780-417e-bbf9-118e6317884f service nova] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a80ad910-4eca-4b32-b445-f1f65b476da7 req-29c2d635-7780-417e-bbf9-118e6317884f service nova] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-a80ad910-4eca-4b32-b445-f1f65b476da7 req-29c2d635-7780-417e-bbf9-118e6317884f service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] No waiting events found dispatching network-vif-plugged-311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:29:16 user nova-compute[75100]: WARNING nova.compute.manager [req-a80ad910-4eca-4b32-b445-f1f65b476da7 req-29c2d635-7780-417e-bbf9-118e6317884f service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Received unexpected event network-vif-plugged-311b11cf-67e8-42ac-9166-8b24a7fb5238 for instance with vm_state deleted and task_state None.
Nov 13 17:29:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:29:16 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:29:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:16 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Deleted allocations for instance e96eb705-85e2-4cce-a91d-5d319b1b5083
Nov 13 17:29:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-95a91942-107d-42c9-bc0c-52b5929b5e04 tempest-VolumesAdminNegativeTest-57814532 tempest-VolumesAdminNegativeTest-57814532-project-member] Lock "e96eb705-85e2-4cce-a91d-5d319b1b5083" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.637s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-70631278-a2db-448b-8a9a-9c8eb4c6c627 req-9e3d39f7-9b01-42a4-b9bb-7c092fbb125e service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-70631278-a2db-448b-8a9a-9c8eb4c6c627 req-9e3d39f7-9b01-42a4-b9bb-7c092fbb125e service nova] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-70631278-a2db-448b-8a9a-9c8eb4c6c627 req-9e3d39f7-9b01-42a4-b9bb-7c092fbb125e service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-70631278-a2db-448b-8a9a-9c8eb4c6c627 req-9e3d39f7-9b01-42a4-b9bb-7c092fbb125e service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-70631278-a2db-448b-8a9a-9c8eb4c6c627 req-9e3d39f7-9b01-42a4-b9bb-7c092fbb125e service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] No waiting events found dispatching network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:29:17 user nova-compute[75100]: WARNING nova.compute.manager [req-70631278-a2db-448b-8a9a-9c8eb4c6c627 req-9e3d39f7-9b01-42a4-b9bb-7c092fbb125e service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received unexpected event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 for instance with vm_state building and task_state spawning.
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-70631278-a2db-448b-8a9a-9c8eb4c6c627 req-9e3d39f7-9b01-42a4-b9bb-7c092fbb125e service nova] [instance: e96eb705-85e2-4cce-a91d-5d319b1b5083] Received event network-vif-deleted-311b11cf-67e8-42ac-9166-8b24a7fb5238 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:29:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Instance spawned successfully.
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:29:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:17 user nova-compute[75100]: INFO nova.compute.manager [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 13 17:29:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:29:17 user nova-compute[75100]: INFO nova.compute.manager [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Took 6.51 seconds to build instance.
Nov 13 17:29:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-673c22f2-91d6-4bdf-a031-047a8b33e14c tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.609s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:19 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:29:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:29:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:29:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:29:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:29:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:29:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:29:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:29:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:29:27 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7355MB free_disk=25.23107147216797GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:29:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d2c4575b-ef8d-4a9d-9650-459366b7227e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d4f158c3-bcd5-4d5b-8c70-04726b17081a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance a10bd002-4f94-4907-994e-7b9f2da6ca3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d30816f4-82ec-43b9-bd47-f34190e5c82f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance a799a142-e6f4-4027-9568-e99d2501ca8e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:29:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Updating instance_info_cache with network_info: [{"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:29:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:29:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:29:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:29:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:29:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:29:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:29:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:29:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:34 user nova-compute[75100]: INFO nova.compute.manager [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Terminating instance
Nov 13 17:29:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-4083418f-fe73-4d5e-8a71-b2689a87a293 req-8e24add3-ed91-48b7-a17e-c96abbc9edb2 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Received event network-vif-unplugged-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4083418f-fe73-4d5e-8a71-b2689a87a293 req-8e24add3-ed91-48b7-a17e-c96abbc9edb2 service nova] Acquiring lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4083418f-fe73-4d5e-8a71-b2689a87a293 req-8e24add3-ed91-48b7-a17e-c96abbc9edb2 service nova] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4083418f-fe73-4d5e-8a71-b2689a87a293 req-8e24add3-ed91-48b7-a17e-c96abbc9edb2 service nova] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-4083418f-fe73-4d5e-8a71-b2689a87a293 req-8e24add3-ed91-48b7-a17e-c96abbc9edb2 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] No waiting events found dispatching network-vif-unplugged-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:29:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-4083418f-fe73-4d5e-8a71-b2689a87a293 req-8e24add3-ed91-48b7-a17e-c96abbc9edb2 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Received event network-vif-unplugged-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:29:35 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Instance destroyed successfully.
Nov 13 17:29:35 user nova-compute[75100]: DEBUG nova.objects.instance [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lazy-loading 'resources' on Instance uuid a10bd002-4f94-4907-994e-7b9f2da6ca3a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:27:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2124080179',display_name='tempest-VolumesActionsTest-instance-2124080179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2124080179',id=23,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:27:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ee9b168baa5460188724804ab3e0c46',ramdisk_id='',reservation_id='r-x9nep5q7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1834502567',owner_user_name='tempest-VolumesActionsTest-1834502567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:27:50Z,user_data=None,user_id='6fd81f3463fe4d81829faabc18c938f8',uuid=a10bd002-4f94-4907-994e-7b9f2da6ca3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "address": "fa:16:3e:86:c3:ca", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc53d9b5-9f", "ovs_interfaceid": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Converting VIF {"id": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "address": "fa:16:3e:86:c3:ca", "network": {"id": "b8d9f00d-b142-4710-a77d-44520ab2472e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-982620926-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ee9b168baa5460188724804ab3e0c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc53d9b5-9f", "ovs_interfaceid": "bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:c3:ca,bridge_name='br-int',has_traffic_filtering=True,id=bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc53d9b5-9f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG os_vif [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c3:ca,bridge_name='br-int',has_traffic_filtering=True,id=bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc53d9b5-9f') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc53d9b5-9f, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bd78ec4-f048-4685-bbf8-f4cf2ec2b2d3) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:35 user nova-compute[75100]: INFO os_vif [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:c3:ca,bridge_name='br-int',has_traffic_filtering=True,id=bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1,network=Network(b8d9f00d-b142-4710-a77d-44520ab2472e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc53d9b5-9f')
Nov 13 17:29:35 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Deleting instance files /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a_del
Nov 13 17:29:35 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Deletion of /opt/stack/data/nova/instances/a10bd002-4f94-4907-994e-7b9f2da6ca3a_del complete
Nov 13 17:29:35 user nova-compute[75100]: INFO nova.compute.manager [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 17:29:35 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:29:35 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Took 0.50 seconds to deallocate network for instance.
Nov 13 17:29:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-8e312b90-ec25-4d87-a1cb-928b31e29b0b req-0dbd2dc5-6e5c-49cf-ba0c-6ddebe918c2f service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Received event network-vif-deleted-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:35 user nova-compute[75100]: INFO nova.compute.manager [req-8e312b90-ec25-4d87-a1cb-928b31e29b0b req-0dbd2dc5-6e5c-49cf-ba0c-6ddebe918c2f service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Neutron deleted interface bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1; detaching it from the instance and deleting it from the info cache
Nov 13 17:29:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-8e312b90-ec25-4d87-a1cb-928b31e29b0b req-0dbd2dc5-6e5c-49cf-ba0c-6ddebe918c2f service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-8e312b90-ec25-4d87-a1cb-928b31e29b0b req-0dbd2dc5-6e5c-49cf-ba0c-6ddebe918c2f service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Detach interface failed, port_id=bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1, reason: Instance a10bd002-4f94-4907-994e-7b9f2da6ca3a could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:36 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:29:36 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:29:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:36 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Deleted allocations for instance a10bd002-4f94-4907-994e-7b9f2da6ca3a
Nov 13 17:29:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-32399376-6308-4cdb-ba2e-7b111054e889 tempest-VolumesActionsTest-1834502567 tempest-VolumesActionsTest-1834502567-project-member] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-2f847872-edd4-41d9-97f0-583bb5897219 req-c2ec96c2-4cc3-4a1c-9ac8-fed0c5d754b2 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Received event network-vif-plugged-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2f847872-edd4-41d9-97f0-583bb5897219 req-c2ec96c2-4cc3-4a1c-9ac8-fed0c5d754b2 service nova] Acquiring lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2f847872-edd4-41d9-97f0-583bb5897219 req-c2ec96c2-4cc3-4a1c-9ac8-fed0c5d754b2 service nova] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2f847872-edd4-41d9-97f0-583bb5897219 req-c2ec96c2-4cc3-4a1c-9ac8-fed0c5d754b2 service nova] Lock "a10bd002-4f94-4907-994e-7b9f2da6ca3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-2f847872-edd4-41d9-97f0-583bb5897219 req-c2ec96c2-4cc3-4a1c-9ac8-fed0c5d754b2 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] No waiting events found dispatching network-vif-plugged-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:29:36 user nova-compute[75100]: WARNING nova.compute.manager [req-2f847872-edd4-41d9-97f0-583bb5897219 req-c2ec96c2-4cc3-4a1c-9ac8-fed0c5d754b2 service nova] [instance: a10bd002-4f94-4907-994e-7b9f2da6ca3a] Received unexpected event network-vif-plugged-bc53d9b5-9fcc-43d6-ae20-793bd5d4a8d1 for instance with vm_state deleted and task_state None.
Nov 13 17:29:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:29:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-97179c13-99c9-4f85-8260-d95000ad2ba2 req-a403495f-d9e9-4411-9ca5-6b7beaf40a76 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-changed-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-97179c13-99c9-4f85-8260-d95000ad2ba2 req-a403495f-d9e9-4411-9ca5-6b7beaf40a76 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Refreshing instance network info cache due to event network-changed-46c2fa4e-5fb5-4798-b9b0-dcf9536addac. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:29:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97179c13-99c9-4f85-8260-d95000ad2ba2 req-a403495f-d9e9-4411-9ca5-6b7beaf40a76 service nova] Acquiring lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:29:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97179c13-99c9-4f85-8260-d95000ad2ba2 req-a403495f-d9e9-4411-9ca5-6b7beaf40a76 service nova] Acquired lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:29:43 user nova-compute[75100]: DEBUG nova.network.neutron [req-97179c13-99c9-4f85-8260-d95000ad2ba2 req-a403495f-d9e9-4411-9ca5-6b7beaf40a76 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Refreshing network info cache for port 46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'flavor' on Instance uuid d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:44 user nova-compute[75100]: INFO nova.compute.manager [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Attaching volume 7aefe5dc-7027-410c-ba6b-988a2f0043e7 to /dev/vdb
Nov 13 17:29:44 user nova-compute[75100]: DEBUG nova.network.neutron [req-97179c13-99c9-4f85-8260-d95000ad2ba2 req-a403495f-d9e9-4411-9ca5-6b7beaf40a76 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updated VIF entry in instance network info cache for port 46c2fa4e-5fb5-4798-b9b0-dcf9536addac. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG nova.network.neutron [req-97179c13-99c9-4f85-8260-d95000ad2ba2 req-a403495f-d9e9-4411-9ca5-6b7beaf40a76 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updating instance_info_cache with network_info: [{"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97179c13-99c9-4f85-8260-d95000ad2ba2 req-a403495f-d9e9-4411-9ca5-6b7beaf40a76 service nova] Releasing lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG os_brick.utils [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29b65e5-e0f0-4986-a5bd-08824fae1afb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8637a4b-8340-4367-b240-66702d52dd59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f839c84-9be1-4ad5-8268-21da435881bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9976b6ea-5f26-4bcf-9152-c4183e29648c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:29:44 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e115f4-e285-4e72-9320-ed6a366ab4e2]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG os_brick.utils [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updating existing volume attachment record: e3fc77ae-13c7-4980-9f35-b8f8db2eb8d0 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'flavor' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:44 user nova-compute[75100]: INFO nova.compute.manager [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attaching volume 231b52ff-e76c-4ab9-ad33-1ae449c983ea to /dev/vdb
Nov 13 17:29:44 user nova-compute[75100]: DEBUG os_brick.utils [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e412d09-f6a4-444c-a3d4-33eff7ddba95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd30daf1-b1cc-474d-a695-054e1bd52f80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9f19f8-8065-4e27-91e0-9eb3ef4726d0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edfa4e1-3336-4e80-b7e5-903c193cddd2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:29:44 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:29:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd8f935-57fd-46b2-8927-0f8943dfa9c1]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG os_brick.utils [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:29:44 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Updating existing volume attachment record: a1cfc9b5-185b-4827-a439-80cef5bdf35b {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:29:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQkJEpdM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:29:48 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:29:48 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:29:48 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[643eac89-bcae-413b-adf0-8f91ae7f41de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:29:48 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94e87df-a081-4476-b590-086c30c4b931]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7] added
Nov 13 17:29:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a9f9f8-35b1-4ff8-8e5c-5e8f208f28e4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[db79ea10-7bb8-4a01-b7d2-db0f5214618e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mQkJEpdM {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mQkJEpdM" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e6c2f3-fd07-4423-a228-4e946ed18a81]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mQkJEpdM'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[53386478-c1d5-40cf-87f6-fac018babe83]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3750459-ba74-421a-b841-40eaa30a8545]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e402b4ba-8280-42fe-8ddc-0257c2d3ca37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7, portal: 172.16.0.220,3260]
Nov 13 17:29:48 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7, portal: 172.16.0.220,3260] successful.
Nov 13 17:29:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbce3bf6-ddd5-4eae-9997-c2870da5e733]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37ddca4-1b8f-4503-9553-bb69e05338f3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:29:48 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[51565877-c9c6-44f1-91d5-ff6e9e2ba43e]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:48 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcoGrBPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:29:49 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQkJEpdM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23735313037383938', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735313037383938', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.713s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:29:49 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:29:49 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG nova.objects.instance [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'flavor' on Instance uuid d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3fa8e3-3117-4cea-b651-5d653c658245]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:29:49 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:29:49 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:29:49 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 13 17:29:49 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:29:49 user nova-compute[75100]:   <serial>7aefe5dc-7027-410c-ba6b-988a2f0043e7</serial>
Nov 13 17:29:49 user nova-compute[75100]: </disk>
Nov 13 17:29:49 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe18751-2375-4656-8090-a783c7b779f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea] added
Nov 13 17:29:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea4e976-dd63-4fe4-b98c-0a7934d8eddb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1a8d8c-e3ba-4dec-a0b4-fb43c90d02a2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcoGrBPu {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dcoGrBPu" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b1c64a-8aa0-461b-b47a-3dccc399e1ea]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dcoGrBPu'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5577ffd9-c0d7-41aa-a14d-27f982279b82]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec8e318-997b-4b77-84f1-f0336b0ad1f1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:29:49 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:29:49 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:29:49 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:29:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:29:49 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:29:49 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:29:49 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:29:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a177c7e0-67b9-48ff-a395-8dcc8d70c5bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea, portal: 172.16.0.220,3260]
Nov 13 17:29:49 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea, portal: 172.16.0.220,3260] successful.
Nov 13 17:29:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baa3f59-a1eb-4d9d-afdb-fe65a2b46e25]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c4f370-ed60-4510-bc5e-8a52dcc5e72a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:29:50 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:29:50 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:29:50 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:29:50 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea (non-flash)
Nov 13 17:29:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:29:50 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:29:50 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:29:50 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:29:50 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea (non-flash)
Nov 13 17:29:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9659d2-be83-460e-abe5-c194a9f63d42]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No VIF found with MAC fa:16:3e:f0:75:c6, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-e165a3fb-6614-4795-a50f-f7c960cc7524 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.116s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:50 user nova-compute[75100]: INFO nova.compute.manager [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Rescuing
Nov 13 17:29:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquired lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:29:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcoGrBPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] <== connect_volume: return (2055ms) {'type': 'block', 'scsi_wwn': '26637333263613231', 'path': '/dev/sdf'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637333263613231', 'path': '/dev/sdf'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG nova.objects.instance [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'flavor' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:29:51 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:29:51 user nova-compute[75100]:   <source dev="/dev/sdf"/>
Nov 13 17:29:51 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:29:51 user nova-compute[75100]:   <serial>231b52ff-e76c-4ab9-ad33-1ae449c983ea</serial>
Nov 13 17:29:51 user nova-compute[75100]: </disk>
Nov 13 17:29:51 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updating instance_info_cache with network_info: [{"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Releasing lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] No VIF found with MAC fa:16:3e:0b:72:c0, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-ebca8d44-a590-482e-a5fd-0d99fda3eaee req-d873aa33-9a68-4ca5-a3cf-7e615978fabc service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-unplugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ebca8d44-a590-482e-a5fd-0d99fda3eaee req-d873aa33-9a68-4ca5-a3cf-7e615978fabc service nova] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ebca8d44-a590-482e-a5fd-0d99fda3eaee req-d873aa33-9a68-4ca5-a3cf-7e615978fabc service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ebca8d44-a590-482e-a5fd-0d99fda3eaee req-d873aa33-9a68-4ca5-a3cf-7e615978fabc service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-ebca8d44-a590-482e-a5fd-0d99fda3eaee req-d873aa33-9a68-4ca5-a3cf-7e615978fabc service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] No waiting events found dispatching network-vif-unplugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:29:51 user nova-compute[75100]: WARNING nova.compute.manager [req-ebca8d44-a590-482e-a5fd-0d99fda3eaee req-d873aa33-9a68-4ca5-a3cf-7e615978fabc service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received unexpected event network-vif-unplugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac for instance with vm_state active and task_state rescuing.
Nov 13 17:29:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-68b30f80-1c83-4497-8caf-56edbedf554e tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.907s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:29:51 user nova-compute[75100]: INFO nova.compute.manager [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] instance snapshotting
Nov 13 17:29:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Beginning live snapshot process
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Instance destroyed successfully.
Nov 13 17:29:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Attempting rescue
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75100) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 17:29:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Creating image(s)
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "/opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "/opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "/opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'trusted_certs' on Instance uuid d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.rescue {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.rescue" returned: 0 in 0.047s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'migration_context' on Instance uuid d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.objects.base [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<d30816f4-82ec-43b9-bd47-f34190e5c82f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Start _get_guest_xml network_info=[{"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "vif_mac": "fa:16:3e:f0:75:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'resources' on Instance uuid d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpae0l3qle/dd3e93c5057943bab0fa424aaeb330c1.delta 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.objects.base [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<d30816f4-82ec-43b9-bd47-f34190e5c82f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'numa_topology' on Instance uuid d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpae0l3qle/dd3e93c5057943bab0fa424aaeb330c1.delta 1073741824" returned: 0 in 0.053s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.objects.base [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<d30816f4-82ec-43b9-bd47-f34190e5c82f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:29:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:29:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'vcpu_model' on Instance uuid d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.objects.base [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<d30816f4-82ec-43b9-bd47-f34190e5c82f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:27:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1020004757',display_name='tempest-ServerRescueNegativeTestJSON-server-1020004757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1020004757',id=24,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG40rnWNdDGw6MfW9fJQy1Qo+Xea5DaDsFvBwt2VMxDpCa3aXwJVnMHiiqQw5ZYsyNK2tVKIhgW2j1pldZydkRtj1dqFcGsv+wEELqc/1VWu3BcXOz51BEeAHnpPKQUIAg==',key_name='tempest-keypair-607988464',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:27:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6c1d1cfd844465e85239be73eb73cec',ramdisk_id='',reservation_id='r-o69if3j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1273984533',owner_user_name='tempest-ServerRescueNegativeTestJSON-1273984533-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:27:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33657093c7ab4112994a1b7e997cfb34',uuid=d30816f4-82ec-43b9-bd47-f34190e5c82f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "vif_mac": "fa:16:3e:f0:75:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converting VIF {"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "vif_mac": "fa:16:3e:f0:75:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=46c2fa4e-5fb5-4798-b9b0-dcf9536addac,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c2fa4e-5f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'pci_devices' on Instance uuid d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.objects.base [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Object Instance<d30816f4-82ec-43b9-bd47-f34190e5c82f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:29:52 user nova-compute[75100]:   <uuid>d30816f4-82ec-43b9-bd47-f34190e5c82f</uuid>
Nov 13 17:29:52 user nova-compute[75100]:   <name>instance-00000018</name>
Nov 13 17:29:52 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:29:52 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:29:52 user nova-compute[75100]:   <metadata>
Nov 13 17:29:52 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:29:52 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:29:52 user nova-compute[75100]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1020004757</nova:name>
Nov 13 17:29:52 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:29:52</nova:creationTime>
Nov 13 17:29:52 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:29:52 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:29:52 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:29:52 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:29:52 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:29:52 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:29:52 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:29:52 user nova-compute[75100]:       <nova:owner>
Nov 13 17:29:52 user nova-compute[75100]:         <nova:user uuid="33657093c7ab4112994a1b7e997cfb34">tempest-ServerRescueNegativeTestJSON-1273984533-project-member</nova:user>
Nov 13 17:29:52 user nova-compute[75100]:         <nova:project uuid="d6c1d1cfd844465e85239be73eb73cec">tempest-ServerRescueNegativeTestJSON-1273984533</nova:project>
Nov 13 17:29:52 user nova-compute[75100]:       </nova:owner>
Nov 13 17:29:52 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:29:52 user nova-compute[75100]:       <nova:ports>
Nov 13 17:29:52 user nova-compute[75100]:         <nova:port uuid="46c2fa4e-5fb5-4798-b9b0-dcf9536addac">
Nov 13 17:29:52 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 17:29:52 user nova-compute[75100]:         </nova:port>
Nov 13 17:29:52 user nova-compute[75100]:       </nova:ports>
Nov 13 17:29:52 user nova-compute[75100]:     </nova:instance>
Nov 13 17:29:52 user nova-compute[75100]:   </metadata>
Nov 13 17:29:52 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:29:52 user nova-compute[75100]:     <system>
Nov 13 17:29:52 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:29:52 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:29:52 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:29:52 user nova-compute[75100]:       <entry name="serial">d30816f4-82ec-43b9-bd47-f34190e5c82f</entry>
Nov 13 17:29:52 user nova-compute[75100]:       <entry name="uuid">d30816f4-82ec-43b9-bd47-f34190e5c82f</entry>
Nov 13 17:29:52 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:29:52 user nova-compute[75100]:     </system>
Nov 13 17:29:52 user nova-compute[75100]:   </sysinfo>
Nov 13 17:29:52 user nova-compute[75100]:   <os>
Nov 13 17:29:52 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:29:52 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:29:52 user nova-compute[75100]:   </os>
Nov 13 17:29:52 user nova-compute[75100]:   <features>
Nov 13 17:29:52 user nova-compute[75100]:     <acpi/>
Nov 13 17:29:52 user nova-compute[75100]:     <apic/>
Nov 13 17:29:52 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:29:52 user nova-compute[75100]:   </features>
Nov 13 17:29:52 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:29:52 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:29:52 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:29:52 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:29:52 user nova-compute[75100]:   </clock>
Nov 13 17:29:52 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:29:52 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:29:52 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:29:52 user nova-compute[75100]:   </cpu>
Nov 13 17:29:52 user nova-compute[75100]:   <devices>
Nov 13 17:29:52 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:29:52 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:29:52 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.rescue"/>
Nov 13 17:29:52 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:29:52 user nova-compute[75100]:     </disk>
Nov 13 17:29:52 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:29:52 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:29:52 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk"/>
Nov 13 17:29:52 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:29:52 user nova-compute[75100]:     </disk>
Nov 13 17:29:52 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:29:52 user nova-compute[75100]:       <mac address="fa:16:3e:f0:75:c6"/>
Nov 13 17:29:52 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:29:52 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:29:52 user nova-compute[75100]:       <target dev="tap46c2fa4e-5f"/>
Nov 13 17:29:52 user nova-compute[75100]:     </interface>
Nov 13 17:29:52 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:29:52 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/console.log" append="off"/>
Nov 13 17:29:52 user nova-compute[75100]:     </serial>
Nov 13 17:29:52 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:29:52 user nova-compute[75100]:     <video>
Nov 13 17:29:52 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:29:52 user nova-compute[75100]:     </video>
Nov 13 17:29:52 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:29:52 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:29:52 user nova-compute[75100]:     </rng>
Nov 13 17:29:52 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:29:52 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:29:52 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:29:52 user nova-compute[75100]:     </memballoon>
Nov 13 17:29:52 user nova-compute[75100]:   </devices>
Nov 13 17:29:52 user nova-compute[75100]: </domain>
Nov 13 17:29:52 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:29:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Instance destroyed successfully.
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:29:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] No VIF found with MAC fa:16:3e:f0:75:c6, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:29:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:29:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-c20a38aa-bf11-4133-9d28-3a1655c226e3 req-81d886e4-bfff-4feb-a52c-ee9b20490bda service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c20a38aa-bf11-4133-9d28-3a1655c226e3 req-81d886e4-bfff-4feb-a52c-ee9b20490bda service nova] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c20a38aa-bf11-4133-9d28-3a1655c226e3 req-81d886e4-bfff-4feb-a52c-ee9b20490bda service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c20a38aa-bf11-4133-9d28-3a1655c226e3 req-81d886e4-bfff-4feb-a52c-ee9b20490bda service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-c20a38aa-bf11-4133-9d28-3a1655c226e3 req-81d886e4-bfff-4feb-a52c-ee9b20490bda service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] No waiting events found dispatching network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:29:53 user nova-compute[75100]: WARNING nova.compute.manager [req-c20a38aa-bf11-4133-9d28-3a1655c226e3 req-81d886e4-bfff-4feb-a52c-ee9b20490bda service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received unexpected event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac for instance with vm_state active and task_state rescuing.
Nov 13 17:29:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:53 user nova-compute[75100]: INFO nova.compute.manager [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Detaching volume 231b52ff-e76c-4ab9-ad33-1ae449c983ea
Nov 13 17:29:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:29:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 17:29:53 user nova-compute[75100]: INFO nova.virt.block_device [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Attempting to driver detach volume 231b52ff-e76c-4ab9-ad33-1ae449c983ea from mountpoint /dev/vdb
Nov 13 17:29:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Attempting to detach device vdb from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:29:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:29:54 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:29:54 user nova-compute[75100]:   <source dev="/dev/sdf"/>
Nov 13 17:29:54 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:29:54 user nova-compute[75100]:   <serial>231b52ff-e76c-4ab9-ad33-1ae449c983ea</serial>
Nov 13 17:29:54 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:29:54 user nova-compute[75100]: </disk>
Nov 13 17:29:54 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:29:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Successfully detached device vdb from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the persistent domain config.
Nov 13 17:29:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:29:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:29:54 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:29:54 user nova-compute[75100]:   <source dev="/dev/sdf"/>
Nov 13 17:29:54 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:29:54 user nova-compute[75100]:   <serial>231b52ff-e76c-4ab9-ad33-1ae449c983ea</serial>
Nov 13 17:29:54 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:29:54 user nova-compute[75100]: </disk>
Nov 13 17:29:54 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:29:54 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:29:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpae0l3qle/dd3e93c5057943bab0fa424aaeb330c1.delta /opt/stack/data/nova/instances/snapshots/tmpae0l3qle/dd3e93c5057943bab0fa424aaeb330c1 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:29:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpae0l3qle/dd3e93c5057943bab0fa424aaeb330c1.delta /opt/stack/data/nova/instances/snapshots/tmpae0l3qle/dd3e93c5057943bab0fa424aaeb330c1" returned: 0 in 0.510s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:29:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Snapshot extracted, beginning image upload
Nov 13 17:29:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-92f820b6-4b2a-44c2-b6d4-e48f8f03a649 req-a54cec74-14e4-4d6d-905a-48af39f0fc75 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92f820b6-4b2a-44c2-b6d4-e48f8f03a649 req-a54cec74-14e4-4d6d-905a-48af39f0fc75 service nova] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92f820b6-4b2a-44c2-b6d4-e48f8f03a649 req-a54cec74-14e4-4d6d-905a-48af39f0fc75 service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92f820b6-4b2a-44c2-b6d4-e48f8f03a649 req-a54cec74-14e4-4d6d-905a-48af39f0fc75 service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-92f820b6-4b2a-44c2-b6d4-e48f8f03a649 req-a54cec74-14e4-4d6d-905a-48af39f0fc75 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] No waiting events found dispatching network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:29:55 user nova-compute[75100]: WARNING nova.compute.manager [req-92f820b6-4b2a-44c2-b6d4-e48f8f03a649 req-a54cec74-14e4-4d6d-905a-48af39f0fc75 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received unexpected event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac for instance with vm_state active and task_state rescuing.
Nov 13 17:29:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-92f820b6-4b2a-44c2-b6d4-e48f8f03a649 req-a54cec74-14e4-4d6d-905a-48af39f0fc75 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92f820b6-4b2a-44c2-b6d4-e48f8f03a649 req-a54cec74-14e4-4d6d-905a-48af39f0fc75 service nova] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92f820b6-4b2a-44c2-b6d4-e48f8f03a649 req-a54cec74-14e4-4d6d-905a-48af39f0fc75 service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92f820b6-4b2a-44c2-b6d4-e48f8f03a649 req-a54cec74-14e4-4d6d-905a-48af39f0fc75 service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:29:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-92f820b6-4b2a-44c2-b6d4-e48f8f03a649 req-a54cec74-14e4-4d6d-905a-48af39f0fc75 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] No waiting events found dispatching network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:29:55 user nova-compute[75100]: WARNING nova.compute.manager [req-92f820b6-4b2a-44c2-b6d4-e48f8f03a649 req-a54cec74-14e4-4d6d-905a-48af39f0fc75 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received unexpected event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac for instance with vm_state active and task_state rescuing.
Nov 13 17:29:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Snapshot image upload complete
Nov 13 17:29:57 user nova-compute[75100]: INFO nova.compute.manager [None req-5c04e32e-4f66-48ec-b088-32e636f76141 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Took 5.36 seconds to snapshot the instance on the hypervisor.
Nov 13 17:29:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-423bb646-3a2a-40e8-9f32-efedecd2d356 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:29:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:29:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:29:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:29:58 user nova-compute[75100]: INFO nova.compute.manager [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Detaching volume 96d5831f-9831-46ee-a088-fcd53a8b9e12
Nov 13 17:29:58 user nova-compute[75100]: INFO nova.virt.block_device [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Attempting to driver detach volume 96d5831f-9831-46ee-a088-fcd53a8b9e12 from mountpoint /dev/vdb
Nov 13 17:29:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Attempting to detach device vdb from instance d2c4575b-ef8d-4a9d-9650-459366b7227e from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:29:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:29:58 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:29:58 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 13 17:29:58 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:29:58 user nova-compute[75100]:   <serial>96d5831f-9831-46ee-a088-fcd53a8b9e12</serial>
Nov 13 17:29:58 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 17:29:58 user nova-compute[75100]: </disk>
Nov 13 17:29:58 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:29:58 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully detached device vdb from instance d2c4575b-ef8d-4a9d-9650-459366b7227e from the persistent domain config.
Nov 13 17:29:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2c4575b-ef8d-4a9d-9650-459366b7227e from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:29:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:29:58 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:29:58 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 13 17:29:58 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:29:58 user nova-compute[75100]:   <serial>96d5831f-9831-46ee-a088-fcd53a8b9e12</serial>
Nov 13 17:29:58 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 17:29:58 user nova-compute[75100]: </disk>
Nov 13 17:29:58 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:29:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:30:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:14 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a is timed out.
Nov 13 17:30:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Successfully detached device vdb from instance d4f158c3-bcd5-4d5b-8c70-04726b17081a from the live domain config.
Nov 13 17:30:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dcoGrBPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:30:14 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffea7e8-6616-45fe-8633-b9124d5b6253]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:30:14 user nova-compute[75100]: No targets found.
Nov 13 17:30:14 user nova-compute[75100]: iSNS:
Nov 13 17:30:14 user nova-compute[75100]: No targets found.
Nov 13 17:30:14 user nova-compute[75100]: STATIC:
Nov 13 17:30:14 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:30:14 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:30:14 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:30:14 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22
Nov 13 17:30:14 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:30:14 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:30:14 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7
Nov 13 17:30:14 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:30:14 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:30:14 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea
Nov 13 17:30:14 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:30:14 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:30:14 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12
Nov 13 17:30:14 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:30:14 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:30:14 user nova-compute[75100]: FIRMWARE:
Nov 13 17:30:14 user nova-compute[75100]: No targets found.
Nov 13 17:30:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:30:14 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:30:14 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e520bd-d8bd-4ea9-a751-bb52f537b0c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8493ed-65b3-4554-92e0-8cfae67cce19]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:30:14 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:30:14 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:30:14 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:30:14 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea (non-flash)
Nov 13 17:30:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:30:14 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:30:14 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:30:14 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:30:14 user nova-compute[75100]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea (non-flash)
Nov 13 17:30:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38d1d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea'): ({'sdf'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Removing single pathed devices sdf {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8601454e-76f4-4939-ad5f-3b32dc447eab]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d589cb-8ef7-4423-b98a-1a64ee5b7f89]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Flushing IO for device /dev/sdf {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c57bd-4e2a-49c0-b8a9-4608f23ab4be]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b6d5ee-473f-4839-8ffc-fe047b8d61d0]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[415fca07-ae6e-4c0c-a0c2-26f3b22fd965]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d492ed0-cadb-4b49-a7e6-9ac53da772d7]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea, portal: 172.16.0.220,3260]
Nov 13 17:30:14 user nova-compute[75100]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea, portal: 172.16.0.220,3260] successful.
Nov 13 17:30:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231b52ff-e76c-4ab9-ad33-1ae449c983ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c89d088-5faa-45cd-a48b-f922f4dcbee7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:30:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] <== disconnect_volume: return (317ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:30:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:30:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'flavor' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:30:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-21b13564-27fc-4e01-bdb8-d0f98af08f8c tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.939s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:30:18 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d2c4575b-ef8d-4a9d-9650-459366b7227e is timed out.
Nov 13 17:30:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully detached device vdb from instance d2c4575b-ef8d-4a9d-9650-459366b7227e from the live domain config.
Nov 13 17:30:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkbQJzAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:30:18 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:30:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7cf3c2-42d1-4e0c-ab6d-e4552c3755c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:30:18 user nova-compute[75100]: No targets found.
Nov 13 17:30:18 user nova-compute[75100]: iSNS:
Nov 13 17:30:18 user nova-compute[75100]: No targets found.
Nov 13 17:30:18 user nova-compute[75100]: STATIC:
Nov 13 17:30:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:30:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:30:18 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:30:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22
Nov 13 17:30:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:30:18 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:30:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7
Nov 13 17:30:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:30:18 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:30:18 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12
Nov 13 17:30:18 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:30:18 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:30:18 user nova-compute[75100]: FIRMWARE:
Nov 13 17:30:18 user nova-compute[75100]: No targets found.
Nov 13 17:30:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:30:18 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:30:18 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[62627c57-2478-4677-b563-c0462e592975]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fe2417-d263-46c9-bd92-50fd43f6b180]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:30:18 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:30:18 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:30:18 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:30:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:30:18 user nova-compute[75100]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 (non-flash)
Nov 13 17:30:18 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:30:18 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:30:18 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c4c3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:30:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[01de66d2-33cb-4a26-a3c7-bae69d820cee]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d8c389-ea95-4ffd-bc87-40b253079a9d]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee5de6a-f8ae-4ced-ab71-2612a305d6c4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec24bcb-e60a-48dc-937f-e6c562c7f95d]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd0c44d-a305-40f3-83a1-cd7d3f8613eb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7471ab-b2ed-4e62-a31e-07d6fb63fb0c]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260]
Nov 13 17:30:19 user nova-compute[75100]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12, portal: 172.16.0.220,3260] successful.
Nov 13 17:30:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96d5831f-9831-46ee-a088-fcd53a8b9e12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[02082288-2956-4f51-af0c-b4a942104642]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] <== disconnect_volume: return (349ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:30:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:30:20 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:30:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f1ba07fa-e073-48d6-9c89-f8616a2e03b0 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.791s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18289a56-41e6-495c-99ae-bd1e04227245 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18289a56-41e6-495c-99ae-bd1e04227245 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-18289a56-41e6-495c-99ae-bd1e04227245 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:30:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-18289a56-41e6-495c-99ae-bd1e04227245 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75100) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 13 17:30:20 user nova-compute[75100]: DEBUG nova.objects.instance [None req-18289a56-41e6-495c-99ae-bd1e04227245 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:30:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:30:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:30:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-7b9d57f8-abd5-4421-9f63-e56b3a43f711 req-6988194e-d283-401a-bd14-31ecd5d1de6a service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-unplugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7b9d57f8-abd5-4421-9f63-e56b3a43f711 req-6988194e-d283-401a-bd14-31ecd5d1de6a service nova] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7b9d57f8-abd5-4421-9f63-e56b3a43f711 req-6988194e-d283-401a-bd14-31ecd5d1de6a service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7b9d57f8-abd5-4421-9f63-e56b3a43f711 req-6988194e-d283-401a-bd14-31ecd5d1de6a service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-7b9d57f8-abd5-4421-9f63-e56b3a43f711 req-6988194e-d283-401a-bd14-31ecd5d1de6a service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] No waiting events found dispatching network-vif-unplugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:30:21 user nova-compute[75100]: WARNING nova.compute.manager [req-7b9d57f8-abd5-4421-9f63-e56b3a43f711 req-6988194e-d283-401a-bd14-31ecd5d1de6a service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received unexpected event network-vif-unplugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd for instance with vm_state active and task_state powering-off.
Nov 13 17:30:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance destroyed successfully.
Nov 13 17:30:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-18289a56-41e6-495c-99ae-bd1e04227245 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:30:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18289a56-41e6-495c-99ae-bd1e04227245 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.027s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-e855f596-9e81-4929-b3f8-f78e495f07e7 req-f393b926-c1ab-4a45-a34d-33ffb438c918 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e855f596-9e81-4929-b3f8-f78e495f07e7 req-f393b926-c1ab-4a45-a34d-33ffb438c918 service nova] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e855f596-9e81-4929-b3f8-f78e495f07e7 req-f393b926-c1ab-4a45-a34d-33ffb438c918 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e855f596-9e81-4929-b3f8-f78e495f07e7 req-f393b926-c1ab-4a45-a34d-33ffb438c918 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-e855f596-9e81-4929-b3f8-f78e495f07e7 req-f393b926-c1ab-4a45-a34d-33ffb438c918 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] No waiting events found dispatching network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:30:23 user nova-compute[75100]: WARNING nova.compute.manager [req-e855f596-9e81-4929-b3f8-f78e495f07e7 req-f393b926-c1ab-4a45-a34d-33ffb438c918 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received unexpected event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd for instance with vm_state stopped and task_state None.
Nov 13 17:30:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-902f5b64-fd51-4ae8-a95c-436bef3a7219 req-248d33d8-a286-4b05-a306-9672ac7c466f service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Received event network-changed-b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-902f5b64-fd51-4ae8-a95c-436bef3a7219 req-248d33d8-a286-4b05-a306-9672ac7c466f service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Refreshing instance network info cache due to event network-changed-b75de1fb-d048-4654-b394-76ccaedb6f34. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-902f5b64-fd51-4ae8-a95c-436bef3a7219 req-248d33d8-a286-4b05-a306-9672ac7c466f service nova] Acquiring lock "refresh_cache-a799a142-e6f4-4027-9568-e99d2501ca8e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-902f5b64-fd51-4ae8-a95c-436bef3a7219 req-248d33d8-a286-4b05-a306-9672ac7c466f service nova] Acquired lock "refresh_cache-a799a142-e6f4-4027-9568-e99d2501ca8e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-902f5b64-fd51-4ae8-a95c-436bef3a7219 req-248d33d8-a286-4b05-a306-9672ac7c466f service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Refreshing network info cache for port b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "a799a142-e6f4-4027-9568-e99d2501ca8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:24 user nova-compute[75100]: INFO nova.compute.manager [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Terminating instance
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-902f5b64-fd51-4ae8-a95c-436bef3a7219 req-248d33d8-a286-4b05-a306-9672ac7c466f service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Updated VIF entry in instance network info cache for port b75de1fb-d048-4654-b394-76ccaedb6f34. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-902f5b64-fd51-4ae8-a95c-436bef3a7219 req-248d33d8-a286-4b05-a306-9672ac7c466f service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Updating instance_info_cache with network_info: [{"id": "b75de1fb-d048-4654-b394-76ccaedb6f34", "address": "fa:16:3e:c8:61:ae", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75de1fb-d0", "ovs_interfaceid": "b75de1fb-d048-4654-b394-76ccaedb6f34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-902f5b64-fd51-4ae8-a95c-436bef3a7219 req-248d33d8-a286-4b05-a306-9672ac7c466f service nova] Releasing lock "refresh_cache-a799a142-e6f4-4027-9568-e99d2501ca8e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Instance destroyed successfully.
Nov 13 17:30:25 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lazy-loading 'resources' on Instance uuid a799a142-e6f4-4027-9568-e99d2501ca8e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-956110543',display_name='tempest-TestVolumeBootPattern-server-956110543',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-956110543',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+NtN2Z5kT0TQJbfKGQsJyKiPak8bepWgNcLUPGujC+AXoGWK840LLNYNacMdPigyvVLHhv89mM2IBFpbgvf3ZqImVEZSa6YyJUnBkkWfhyP+tfJPZtUfdOTGbNpjZ7sA==',key_name='tempest-TestVolumeBootPattern-2052596683',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:28:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-0eq7pew1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:28:43Z,user_data=None,user_id='421484d1f180498fa5e078c084d70986',uuid=a799a142-e6f4-4027-9568-e99d2501ca8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b75de1fb-d048-4654-b394-76ccaedb6f34", "address": "fa:16:3e:c8:61:ae", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75de1fb-d0", "ovs_interfaceid": "b75de1fb-d048-4654-b394-76ccaedb6f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "b75de1fb-d048-4654-b394-76ccaedb6f34", "address": "fa:16:3e:c8:61:ae", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb75de1fb-d0", "ovs_interfaceid": "b75de1fb-d048-4654-b394-76ccaedb6f34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:61:ae,bridge_name='br-int',has_traffic_filtering=True,id=b75de1fb-d048-4654-b394-76ccaedb6f34,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75de1fb-d0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG os_vif [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:61:ae,bridge_name='br-int',has_traffic_filtering=True,id=b75de1fb-d048-4654-b394-76ccaedb6f34,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75de1fb-d0') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb75de1fb-d0, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60515381-2d0e-49c9-844d-07c6b5a17c3b) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:25 user nova-compute[75100]: INFO os_vif [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:61:ae,bridge_name='br-int',has_traffic_filtering=True,id=b75de1fb-d048-4654-b394-76ccaedb6f34,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb75de1fb-d0')
Nov 13 17:30:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJYlfmHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:30:25 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:30:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[809f485e-1ef0-46aa-b5b9-6df155ba3636]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:30:25 user nova-compute[75100]: No targets found.
Nov 13 17:30:25 user nova-compute[75100]: iSNS:
Nov 13 17:30:25 user nova-compute[75100]: No targets found.
Nov 13 17:30:25 user nova-compute[75100]: STATIC:
Nov 13 17:30:25 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:30:25 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:30:25 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:30:25 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22
Nov 13 17:30:25 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:30:25 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:30:25 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7
Nov 13 17:30:25 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:30:25 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:30:25 user nova-compute[75100]: FIRMWARE:
Nov 13 17:30:25 user nova-compute[75100]: No targets found.
Nov 13 17:30:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:30:25 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:30:25 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e32b159-7082-4595-a2bf-7395ebd5943d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[22929deb-13ae-4afd-96db-eb105510d12f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:30:26 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:30:26 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:30:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:30:26 user nova-compute[75100]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:30:26 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:30:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38f74ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[349f1533-3bf2-47f5-bb21-aee28c5e20f0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fe6a7a-1d44-4892-bd4a-256faf2ecc5a]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eb4013-ad6e-4b10-9fba-f4d34e06ad6c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f358ad05-753c-460e-bc1d-6f5e67113aad]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO135058b5-7153cd8c3dee81c0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_135058b5', '/dev/disk/by-id/scsi-23731353363643863') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[324b9218-da57-432e-8803-d359498662f5]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[288aa310-5695-4a29-b9b9-5860002af7c9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3171c9-ae91-43a0-b512-7a1d5dbf59a2]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260]
Nov 13 17:30:26 user nova-compute[75100]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260] successful.
Nov 13 17:30:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0f8eae-b6e5-49ed-9927-27e2bbfb6869]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== disconnect_volume: return (353ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:30:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Deleting instance files /opt/stack/data/nova/instances/a799a142-e6f4-4027-9568-e99d2501ca8e_del
Nov 13 17:30:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Deletion of /opt/stack/data/nova/instances/a799a142-e6f4-4027-9568-e99d2501ca8e_del complete
Nov 13 17:30:26 user nova-compute[75100]: INFO nova.compute.manager [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid 'a799a142-e6f4-4027-9568-e99d2501ca8e' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a799a142-e6f4-4027-9568-e99d2501ca8e' (instance-0000001a)
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-29a76303-89a4-40e5-a5c3-dcce704b2392 req-d9a12ae8-a91b-4f13-889f-2bbcd4449003 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Received event network-vif-unplugged-b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-29a76303-89a4-40e5-a5c3-dcce704b2392 req-d9a12ae8-a91b-4f13-889f-2bbcd4449003 service nova] Acquiring lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-29a76303-89a4-40e5-a5c3-dcce704b2392 req-d9a12ae8-a91b-4f13-889f-2bbcd4449003 service nova] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-29a76303-89a4-40e5-a5c3-dcce704b2392 req-d9a12ae8-a91b-4f13-889f-2bbcd4449003 service nova] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-29a76303-89a4-40e5-a5c3-dcce704b2392 req-d9a12ae8-a91b-4f13-889f-2bbcd4449003 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] No waiting events found dispatching network-vif-unplugged-b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-29a76303-89a4-40e5-a5c3-dcce704b2392 req-d9a12ae8-a91b-4f13-889f-2bbcd4449003 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Received event network-vif-unplugged-b75de1fb-d048-4654-b394-76ccaedb6f34 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-29a76303-89a4-40e5-a5c3-dcce704b2392 req-d9a12ae8-a91b-4f13-889f-2bbcd4449003 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Received event network-vif-plugged-b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-29a76303-89a4-40e5-a5c3-dcce704b2392 req-d9a12ae8-a91b-4f13-889f-2bbcd4449003 service nova] Acquiring lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-29a76303-89a4-40e5-a5c3-dcce704b2392 req-d9a12ae8-a91b-4f13-889f-2bbcd4449003 service nova] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-29a76303-89a4-40e5-a5c3-dcce704b2392 req-d9a12ae8-a91b-4f13-889f-2bbcd4449003 service nova] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-29a76303-89a4-40e5-a5c3-dcce704b2392 req-d9a12ae8-a91b-4f13-889f-2bbcd4449003 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] No waiting events found dispatching network-vif-plugged-b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:30:26 user nova-compute[75100]: WARNING nova.compute.manager [req-29a76303-89a4-40e5-a5c3-dcce704b2392 req-d9a12ae8-a91b-4f13-889f-2bbcd4449003 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Received unexpected event network-vif-plugged-b75de1fb-d048-4654-b394-76ccaedb6f34 for instance with vm_state active and task_state deleting.
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-50530841-3fb7-4664-8869-f997f5f494c4 req-66743396-9649-4a35-84b8-d36b8c0044c1 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Received event network-vif-deleted-b75de1fb-d048-4654-b394-76ccaedb6f34 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:27 user nova-compute[75100]: INFO nova.compute.manager [req-50530841-3fb7-4664-8869-f997f5f494c4 req-66743396-9649-4a35-84b8-d36b8c0044c1 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Neutron deleted interface b75de1fb-d048-4654-b394-76ccaedb6f34; detaching it from the instance and deleting it from the info cache
Nov 13 17:30:27 user nova-compute[75100]: DEBUG nova.network.neutron [req-50530841-3fb7-4664-8869-f997f5f494c4 req-66743396-9649-4a35-84b8-d36b8c0044c1 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:30:27 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:30:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-50530841-3fb7-4664-8869-f997f5f494c4 req-66743396-9649-4a35-84b8-d36b8c0044c1 service nova] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Detach interface failed, port_id=b75de1fb-d048-4654-b394-76ccaedb6f34, reason: Instance a799a142-e6f4-4027-9568-e99d2501ca8e could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:30:27 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Took 0.68 seconds to deallocate network for instance.
Nov 13 17:30:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:28 user nova-compute[75100]: INFO nova.compute.manager [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: a799a142-e6f4-4027-9568-e99d2501ca8e] Took 0.94 seconds to detach 1 volumes for instance.
Nov 13 17:30:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:30:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7630MB free_disk=25.177978515625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d2c4575b-ef8d-4a9d-9650-459366b7227e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d4f158c3-bcd5-4d5b-8c70-04726b17081a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d30816f4-82ec-43b9-bd47-f34190e5c82f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance a799a142-e6f4-4027-9568-e99d2501ca8e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.441s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:30:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:28 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Deleted allocations for instance a799a142-e6f4-4027-9568-e99d2501ca8e
Nov 13 17:30:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a311473a-862c-4efe-bcde-dc95362db430 tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "a799a142-e6f4-4027-9568-e99d2501ca8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.014s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:30:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:30:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:30:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:30:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:30:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updating instance_info_cache with network_info: [{"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:30:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:30:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:30:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:30:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:30:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:30:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:30:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:30:31 user nova-compute[75100]: INFO nova.compute.claims [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Claim successful on node user
Nov 13 17:30:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Refreshing inventories for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Updating ProviderTree inventory for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Updating inventory in ProviderTree for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Refreshing aggregate associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Refreshing trait associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:30:31 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:30:31 user nova-compute[75100]: DEBUG nova.policy [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b10372a7ca7845d8970b4f957afd249d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b8e980410348b48bf04fc382c4e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:30:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Creating image(s)
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk 1073741824" returned: 0 in 0.061s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Successfully created port: 06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Cannot resize image /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Ensure instance console log exists: /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Successfully updated port: 06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquired lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-991721cc-990b-4872-a3ea-cf1ea25aa27f req-819c285c-8e8f-4ab4-a67b-2f8a4fcb599b service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-changed-06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-991721cc-990b-4872-a3ea-cf1ea25aa27f req-819c285c-8e8f-4ab4-a67b-2f8a4fcb599b service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Refreshing instance network info cache due to event network-changed-06242103-0705-434a-8b09-54be30f73283. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-991721cc-990b-4872-a3ea-cf1ea25aa27f req-819c285c-8e8f-4ab4-a67b-2f8a4fcb599b service nova] Acquiring lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Updating instance_info_cache with network_info: [{"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Releasing lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Instance network_info: |[{"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-991721cc-990b-4872-a3ea-cf1ea25aa27f req-819c285c-8e8f-4ab4-a67b-2f8a4fcb599b service nova] Acquired lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-991721cc-990b-4872-a3ea-cf1ea25aa27f req-819c285c-8e8f-4ab4-a67b-2f8a4fcb599b service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Refreshing network info cache for port 06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Start _get_guest_xml network_info=[{"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:30:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:30:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1119793217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1119793217',id=28,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvx8JQIBkL21nN5cuKYIjTT8NnZAWSZMP2QkZAc6pbLZaJgU2fYiAQEBg0Xgdwf3KsbdPq5Sf/a+dIZy7MOu0OovA6J7QJWFX9Lec9YN4YQPY7+toKNUPqHUKmWixmRqw==',key_name='tempest-keypair-1552872187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48b8e980410348b48bf04fc382c4e60c',ramdisk_id='',reservation_id='r-n03514yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1699715910',owner_user_name='tempest-TaggedAttachmentsTest-1699715910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:30:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b10372a7ca7845d8970b4f957afd249d',uuid=bcb48f07-30a1-48a1-b739-49bf2513c013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converting VIF {"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:85:9d,bridge_name='br-int',has_traffic_filtering=True,id=06242103-0705-434a-8b09-54be30f73283,network=Network(fa03dec8-6055-44af-ae76-a694d6f84136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06242103-07') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.objects.instance [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lazy-loading 'pci_devices' on Instance uuid bcb48f07-30a1-48a1-b739-49bf2513c013 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:30:33 user nova-compute[75100]:   <uuid>bcb48f07-30a1-48a1-b739-49bf2513c013</uuid>
Nov 13 17:30:33 user nova-compute[75100]:   <name>instance-0000001c</name>
Nov 13 17:30:33 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:30:33 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:30:33 user nova-compute[75100]:   <metadata>
Nov 13 17:30:33 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:30:33 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:30:33 user nova-compute[75100]:       <nova:name>tempest-device-tagging-server-1119793217</nova:name>
Nov 13 17:30:33 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:30:33</nova:creationTime>
Nov 13 17:30:33 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:30:33 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:30:33 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:30:33 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:30:33 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:30:33 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:30:33 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:30:33 user nova-compute[75100]:       <nova:owner>
Nov 13 17:30:33 user nova-compute[75100]:         <nova:user uuid="b10372a7ca7845d8970b4f957afd249d">tempest-TaggedAttachmentsTest-1699715910-project-member</nova:user>
Nov 13 17:30:33 user nova-compute[75100]:         <nova:project uuid="48b8e980410348b48bf04fc382c4e60c">tempest-TaggedAttachmentsTest-1699715910</nova:project>
Nov 13 17:30:33 user nova-compute[75100]:       </nova:owner>
Nov 13 17:30:33 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:30:33 user nova-compute[75100]:       <nova:ports>
Nov 13 17:30:33 user nova-compute[75100]:         <nova:port uuid="06242103-0705-434a-8b09-54be30f73283">
Nov 13 17:30:33 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 17:30:33 user nova-compute[75100]:         </nova:port>
Nov 13 17:30:33 user nova-compute[75100]:       </nova:ports>
Nov 13 17:30:33 user nova-compute[75100]:     </nova:instance>
Nov 13 17:30:33 user nova-compute[75100]:   </metadata>
Nov 13 17:30:33 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:30:33 user nova-compute[75100]:     <system>
Nov 13 17:30:33 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:30:33 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:30:33 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:30:33 user nova-compute[75100]:       <entry name="serial">bcb48f07-30a1-48a1-b739-49bf2513c013</entry>
Nov 13 17:30:33 user nova-compute[75100]:       <entry name="uuid">bcb48f07-30a1-48a1-b739-49bf2513c013</entry>
Nov 13 17:30:33 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:30:33 user nova-compute[75100]:     </system>
Nov 13 17:30:33 user nova-compute[75100]:   </sysinfo>
Nov 13 17:30:33 user nova-compute[75100]:   <os>
Nov 13 17:30:33 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:30:33 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:30:33 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:30:33 user nova-compute[75100]:   </os>
Nov 13 17:30:33 user nova-compute[75100]:   <features>
Nov 13 17:30:33 user nova-compute[75100]:     <acpi/>
Nov 13 17:30:33 user nova-compute[75100]:     <apic/>
Nov 13 17:30:33 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:30:33 user nova-compute[75100]:   </features>
Nov 13 17:30:33 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:30:33 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:30:33 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:30:33 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:30:33 user nova-compute[75100]:   </clock>
Nov 13 17:30:33 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:30:33 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:30:33 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:30:33 user nova-compute[75100]:   </cpu>
Nov 13 17:30:33 user nova-compute[75100]:   <devices>
Nov 13 17:30:33 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:30:33 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:30:33 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk"/>
Nov 13 17:30:33 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:30:33 user nova-compute[75100]:     </disk>
Nov 13 17:30:33 user nova-compute[75100]:     <disk type="file" device="cdrom">
Nov 13 17:30:33 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 17:30:33 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk.config"/>
Nov 13 17:30:33 user nova-compute[75100]:       <target dev="hda" bus="ide"/>
Nov 13 17:30:33 user nova-compute[75100]:     </disk>
Nov 13 17:30:33 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:30:33 user nova-compute[75100]:       <mac address="fa:16:3e:3b:85:9d"/>
Nov 13 17:30:33 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:30:33 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:30:33 user nova-compute[75100]:       <target dev="tap06242103-07"/>
Nov 13 17:30:33 user nova-compute[75100]:     </interface>
Nov 13 17:30:33 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:30:33 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/console.log" append="off"/>
Nov 13 17:30:33 user nova-compute[75100]:     </serial>
Nov 13 17:30:33 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:30:33 user nova-compute[75100]:     <video>
Nov 13 17:30:33 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:30:33 user nova-compute[75100]:     </video>
Nov 13 17:30:33 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:30:33 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:30:33 user nova-compute[75100]:     </rng>
Nov 13 17:30:33 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:30:33 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:30:33 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:30:33 user nova-compute[75100]:     </memballoon>
Nov 13 17:30:33 user nova-compute[75100]:   </devices>
Nov 13 17:30:33 user nova-compute[75100]: </domain>
Nov 13 17:30:33 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1119793217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1119793217',id=28,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvx8JQIBkL21nN5cuKYIjTT8NnZAWSZMP2QkZAc6pbLZaJgU2fYiAQEBg0Xgdwf3KsbdPq5Sf/a+dIZy7MOu0OovA6J7QJWFX9Lec9YN4YQPY7+toKNUPqHUKmWixmRqw==',key_name='tempest-keypair-1552872187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48b8e980410348b48bf04fc382c4e60c',ramdisk_id='',reservation_id='r-n03514yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1699715910',owner_user_name='tempest-TaggedAttachmentsTest-1699715910-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:30:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b10372a7ca7845d8970b4f957afd249d',uuid=bcb48f07-30a1-48a1-b739-49bf2513c013,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converting VIF {"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:85:9d,bridge_name='br-int',has_traffic_filtering=True,id=06242103-0705-434a-8b09-54be30f73283,network=Network(fa03dec8-6055-44af-ae76-a694d6f84136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06242103-07') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG os_vif [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:85:9d,bridge_name='br-int',has_traffic_filtering=True,id=06242103-0705-434a-8b09-54be30f73283,network=Network(fa03dec8-6055-44af-ae76-a694d6f84136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06242103-07') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb102fe5-b3eb-5cbe-b050-3ba71ca7e8c1', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06242103-07, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06242103-07, col_values=(('qos', UUID('57a9fc80-c5bb-4a9d-932e-f9cadd4584ff')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06242103-07, col_values=(('external_ids', {'iface-id': '06242103-0705-434a-8b09-54be30f73283', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:85:9d', 'vm-uuid': 'bcb48f07-30a1-48a1-b739-49bf2513c013'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:33 user nova-compute[75100]: INFO os_vif [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:85:9d,bridge_name='br-int',has_traffic_filtering=True,id=06242103-0705-434a-8b09-54be30f73283,network=Network(fa03dec8-6055-44af-ae76-a694d6f84136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06242103-07')
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] No BDM found with device name hda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] No VIF found with MAC fa:16:3e:3b:85:9d, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:30:33 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Using config drive
Nov 13 17:30:33 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Creating config drive at /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk.config
Nov 13 17:30:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9pfb2_8a {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-991721cc-990b-4872-a3ea-cf1ea25aa27f req-819c285c-8e8f-4ab4-a67b-2f8a4fcb599b service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Updated VIF entry in instance network info cache for port 06242103-0705-434a-8b09-54be30f73283. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-991721cc-990b-4872-a3ea-cf1ea25aa27f req-819c285c-8e8f-4ab4-a67b-2f8a4fcb599b service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Updating instance_info_cache with network_info: [{"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9pfb2_8a" returned: 0 in 0.068s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-991721cc-990b-4872-a3ea-cf1ea25aa27f req-819c285c-8e8f-4ab4-a67b-2f8a4fcb599b service nova] Releasing lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:30:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-ed2d8ef4-7393-48a0-bad4-95280c0b6211 req-8dfd5422-3316-494e-aa4a-07bf0c10a056 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-vif-plugged-06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ed2d8ef4-7393-48a0-bad4-95280c0b6211 req-8dfd5422-3316-494e-aa4a-07bf0c10a056 service nova] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ed2d8ef4-7393-48a0-bad4-95280c0b6211 req-8dfd5422-3316-494e-aa4a-07bf0c10a056 service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ed2d8ef4-7393-48a0-bad4-95280c0b6211 req-8dfd5422-3316-494e-aa4a-07bf0c10a056 service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-ed2d8ef4-7393-48a0-bad4-95280c0b6211 req-8dfd5422-3316-494e-aa4a-07bf0c10a056 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] No waiting events found dispatching network-vif-plugged-06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:30:35 user nova-compute[75100]: WARNING nova.compute.manager [req-ed2d8ef4-7393-48a0-bad4-95280c0b6211 req-8dfd5422-3316-494e-aa4a-07bf0c10a056 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received unexpected event network-vif-plugged-06242103-0705-434a-8b09-54be30f73283 for instance with vm_state building and task_state spawning.
Nov 13 17:30:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:30:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Instance spawned successfully.
Nov 13 17:30:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:30:37 user nova-compute[75100]: INFO nova.compute.manager [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 13 17:30:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-1eb0d570-2371-46d5-985e-aad8fa871769 req-2aa9527c-32df-438c-aee6-ef9c7adf9392 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-vif-plugged-06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1eb0d570-2371-46d5-985e-aad8fa871769 req-2aa9527c-32df-438c-aee6-ef9c7adf9392 service nova] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1eb0d570-2371-46d5-985e-aad8fa871769 req-2aa9527c-32df-438c-aee6-ef9c7adf9392 service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1eb0d570-2371-46d5-985e-aad8fa871769 req-2aa9527c-32df-438c-aee6-ef9c7adf9392 service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-1eb0d570-2371-46d5-985e-aad8fa871769 req-2aa9527c-32df-438c-aee6-ef9c7adf9392 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] No waiting events found dispatching network-vif-plugged-06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:30:37 user nova-compute[75100]: WARNING nova.compute.manager [req-1eb0d570-2371-46d5-985e-aad8fa871769 req-2aa9527c-32df-438c-aee6-ef9c7adf9392 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received unexpected event network-vif-plugged-06242103-0705-434a-8b09-54be30f73283 for instance with vm_state building and task_state spawning.
Nov 13 17:30:37 user nova-compute[75100]: INFO nova.compute.manager [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Took 6.57 seconds to build instance.
Nov 13 17:30:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb69ff32-f1c3-4682-b9e6-c62dcb853d2a tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.700s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "73c5d863-7cae-481f-b8ea-dfc217514658" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:30:52 user nova-compute[75100]: INFO nova.compute.claims [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Claim successful on node user
Nov 13 17:30:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:30:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:30:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:30:52 user nova-compute[75100]: INFO nova.virt.block_device [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Booting with volume b6f577ba-2aaa-4622-8530-3e5461d39c23 at /dev/vda
Nov 13 17:30:52 user nova-compute[75100]: DEBUG nova.policy [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ea28cc48696459f96e7ad8dacad33da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119dde6420324f52a165a5610c77d1c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG os_brick.utils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc177588-2161-4222-9d06-51460fd8ea79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d77056-61ac-489b-aa9d-57415c30066a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ab48c5-6ead-43e8-ab11-09b1fb55765d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2316400-88bf-483e-8180-e6311bdf7e71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:30:52 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:30:52 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8212ab4d-84b2-41b7-91e2-ed20142f3295]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG os_brick.utils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:30:52 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Updating existing volume attachment record: aad3fde9-3f64-41e9-8a2f-ba9450ab1730 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:30:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Successfully created port: abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:30:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:53 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Successfully updated port: abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:30:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-1cc474f0-4570-499b-8f86-27e281bc255c req-a4f649a7-22dc-48f5-aee4-16d7d3105918 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received event network-changed-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-1cc474f0-4570-499b-8f86-27e281bc255c req-a4f649a7-22dc-48f5-aee4-16d7d3105918 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Refreshing instance network info cache due to event network-changed-abbcd619-e7dc-4dd0-b1a4-4c542462c321. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1cc474f0-4570-499b-8f86-27e281bc255c req-a4f649a7-22dc-48f5-aee4-16d7d3105918 service nova] Acquiring lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1cc474f0-4570-499b-8f86-27e281bc255c req-a4f649a7-22dc-48f5-aee4-16d7d3105918 service nova] Acquired lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:30:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-1cc474f0-4570-499b-8f86-27e281bc255c req-a4f649a7-22dc-48f5-aee4-16d7d3105918 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Refreshing network info cache for port abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:30:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:30:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-1cc474f0-4570-499b-8f86-27e281bc255c req-a4f649a7-22dc-48f5-aee4-16d7d3105918 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:30:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-1cc474f0-4570-499b-8f86-27e281bc255c req-a4f649a7-22dc-48f5-aee4-16d7d3105918 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:30:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1cc474f0-4570-499b-8f86-27e281bc255c req-a4f649a7-22dc-48f5-aee4-16d7d3105918 service nova] Releasing lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:30:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquired lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:30:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:30:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:30:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Updating instance_info_cache with network_info: [{"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:30:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Releasing lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:30:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Instance network_info: |[{"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:56 user nova-compute[75100]: INFO nova.compute.manager [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Terminating instance
Nov 13 17:30:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-b75225bc-ae96-449c-9ccd-a56cb03cee91 req-d8a099ec-7452-48dd-a237-f617d8a18563 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Received event network-vif-unplugged-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b75225bc-ae96-449c-9ccd-a56cb03cee91 req-d8a099ec-7452-48dd-a237-f617d8a18563 service nova] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b75225bc-ae96-449c-9ccd-a56cb03cee91 req-d8a099ec-7452-48dd-a237-f617d8a18563 service nova] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b75225bc-ae96-449c-9ccd-a56cb03cee91 req-d8a099ec-7452-48dd-a237-f617d8a18563 service nova] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-b75225bc-ae96-449c-9ccd-a56cb03cee91 req-d8a099ec-7452-48dd-a237-f617d8a18563 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] No waiting events found dispatching network-vif-unplugged-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:30:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-b75225bc-ae96-449c-9ccd-a56cb03cee91 req-d8a099ec-7452-48dd-a237-f617d8a18563 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Received event network-vif-unplugged-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:30:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Instance destroyed successfully.
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lazy-loading 'resources' on Instance uuid d4f158c3-bcd5-4d5b-8c70-04726b17081a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1920556531',display_name='tempest-SnapshotDataIntegrityTests-server-1920556531',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1920556531',id=19,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImg0P2/gD3p89dx37HUzmjIDR2e+piPOmxufBicTKFAd6AzX4KNnTXKdVl4u8pkQ4n2VnBaYLIGtCRoRhw+xPYxpliG4UDIoA5mcFisn2kLSEU4wtiVRdvVSBjpjn4Mmw==',key_name='tempest-keypair-1224768050',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:24:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1275e18265645a7a2f9be240c26cc36',ramdisk_id='',reservation_id='r-gdgh64w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1370226818',owner_user_name='tempest-SnapshotDataIntegrityTests-1370226818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0b1c7977a9484495b30bcbbbf7710eba',uuid=d4f158c3-bcd5-4d5b-8c70-04726b17081a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "address": "fa:16:3e:0b:72:c0", "network": {"id": "09e96b0d-2707-43df-806a-5b8b09f24843", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1641478356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1275e18265645a7a2f9be240c26cc36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f33ad4-03", "ovs_interfaceid": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Converting VIF {"id": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "address": "fa:16:3e:0b:72:c0", "network": {"id": "09e96b0d-2707-43df-806a-5b8b09f24843", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1641478356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1275e18265645a7a2f9be240c26cc36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8f33ad4-03", "ovs_interfaceid": "a8f33ad4-03cc-4458-b977-d8db6b1aeb30", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:72:c0,bridge_name='br-int',has_traffic_filtering=True,id=a8f33ad4-03cc-4458-b977-d8db6b1aeb30,network=Network(09e96b0d-2707-43df-806a-5b8b09f24843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f33ad4-03') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_vif [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:72:c0,bridge_name='br-int',has_traffic_filtering=True,id=a8f33ad4-03cc-4458-b977-d8db6b1aeb30,network=Network(09e96b0d-2707-43df-806a-5b8b09f24843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f33ad4-03') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8f33ad4-03, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cb4e748-f012-4382-b7f0-ebadd805dcd3) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:57 user nova-compute[75100]: INFO os_vif [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:72:c0,bridge_name='br-int',has_traffic_filtering=True,id=a8f33ad4-03cc-4458-b977-d8db6b1aeb30,network=Network(09e96b0d-2707-43df-806a-5b8b09f24843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8f33ad4-03')
Nov 13 17:30:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Deleting instance files /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a_del
Nov 13 17:30:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Deletion of /opt/stack/data/nova/instances/d4f158c3-bcd5-4d5b-8c70-04726b17081a_del complete
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:30:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Creating image(s)
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Ensure instance console log exists: /opt/stack/data/nova/instances/73c5d863-7cae-481f-b8ea-dfc217514658/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Start _get_guest_xml network_info=[{"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'aad3fde9-3f64-41e9-8a2f-ba9450ab1730', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZlmQkVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '73c5d863-7cae-481f-b8ea-dfc217514658', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6f577ba-2aaa-4622-8530-3e5461d39c23', 'serial': 'b6f577ba-2aaa-4622-8530-3e5461d39c23'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:30:57 user nova-compute[75100]: INFO nova.compute.manager [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:30:57 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:30:57 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZlmQkVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:30:57 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:30:57 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:30:57 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:30:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c828efe-59e6-4d51-be60-b93906902e5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:30:57 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cc7c53-ed3f-4c5d-b582-f6315c40fae9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23] added
Nov 13 17:30:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac836947-1dba-4bb5-93ca-8408bfee10cd]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8a6ee8-cd61-44e9-87ed-a81e59057cc6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZlmQkVS {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZlmQkVS" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce01a240-f30e-4ccc-9da2-d5c4984d6273]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CZlmQkVS'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedba57a-746a-447e-a878-8cdabc9c0ba0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f230d01-5b31-4622-9242-237ff88f24ec]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:30:57 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:30:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:30:57 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:30:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb454ec0-09a1-4ec6-a7df-a693e247286d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260]
Nov 13 17:30:57 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260] successful.
Nov 13 17:30:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[89533214-4da2-4d55-a7cd-5ef4b12a2405]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f90b5ae-3223-4393-a840-fce34997b027]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:30:57 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:30:57 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:30:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:30:57 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:30:57 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:30:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fb3faa-1d7e-4094-b7dc-07de52cd3350]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:30:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZlmQkVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-43fd186c-c05c-4f3a-ac8e-f63d3900e5b2 req-8581c43f-083e-4e52-ae40-066d26ce1ec0 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Received event network-vif-deleted-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:58 user nova-compute[75100]: INFO nova.compute.manager [req-43fd186c-c05c-4f3a-ac8e-f63d3900e5b2 req-8581c43f-083e-4e52-ae40-066d26ce1ec0 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Neutron deleted interface a8f33ad4-03cc-4458-b977-d8db6b1aeb30; detaching it from the instance and deleting it from the info cache
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.network.neutron [req-43fd186c-c05c-4f3a-ac8e-f63d3900e5b2 req-8581c43f-083e-4e52-ae40-066d26ce1ec0 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:30:58 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Took 0.82 seconds to deallocate network for instance.
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-43fd186c-c05c-4f3a-ac8e-f63d3900e5b2 req-8581c43f-083e-4e52-ae40-066d26ce1ec0 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Detach interface failed, port_id=a8f33ad4-03cc-4458-b977-d8db6b1aeb30, reason: Instance d4f158c3-bcd5-4d5b-8c70-04726b17081a could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:58 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Deleted allocations for instance d4f158c3-bcd5-4d5b-8c70-04726b17081a
Nov 13 17:30:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ba5965f8-3532-46a5-8efe-62458a92388d tempest-SnapshotDataIntegrityTests-1370226818 tempest-SnapshotDataIntegrityTests-1370226818-project-member] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.418s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23632643032313730', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632643032313730', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-95005404',display_name='tempest-ServerActionsTestOtherA-server-95005404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-95005404',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArXX8H/F/4k/bCD26MQyJfYc6kVyijAa21ATX3s9SJ4y/SgOLDqvjWXABytQ7Y0rezN8922Yqg0PmzPzy90j9+erJSCwuQJnigd+guQkVWmuyFrLUQ16eK1oB+ijXr+Rw==',key_name='tempest-keypair-216019137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-g1hxuk35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=73c5d863-7cae-481f-b8ea-dfc217514658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lazy-loading 'pci_devices' on Instance uuid 73c5d863-7cae-481f-b8ea-dfc217514658 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:30:58 user nova-compute[75100]:   <uuid>73c5d863-7cae-481f-b8ea-dfc217514658</uuid>
Nov 13 17:30:58 user nova-compute[75100]:   <name>instance-0000001d</name>
Nov 13 17:30:58 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:30:58 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:30:58 user nova-compute[75100]:   <metadata>
Nov 13 17:30:58 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:30:58 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:30:58 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherA-server-95005404</nova:name>
Nov 13 17:30:58 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:30:57</nova:creationTime>
Nov 13 17:30:58 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:30:58 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:30:58 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:30:58 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:30:58 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:30:58 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:30:58 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:30:58 user nova-compute[75100]:       <nova:owner>
Nov 13 17:30:58 user nova-compute[75100]:         <nova:user uuid="7ea28cc48696459f96e7ad8dacad33da">tempest-ServerActionsTestOtherA-226710821-project-member</nova:user>
Nov 13 17:30:58 user nova-compute[75100]:         <nova:project uuid="119dde6420324f52a165a5610c77d1c3">tempest-ServerActionsTestOtherA-226710821</nova:project>
Nov 13 17:30:58 user nova-compute[75100]:       </nova:owner>
Nov 13 17:30:58 user nova-compute[75100]:       <nova:ports>
Nov 13 17:30:58 user nova-compute[75100]:         <nova:port uuid="abbcd619-e7dc-4dd0-b1a4-4c542462c321">
Nov 13 17:30:58 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 17:30:58 user nova-compute[75100]:         </nova:port>
Nov 13 17:30:58 user nova-compute[75100]:       </nova:ports>
Nov 13 17:30:58 user nova-compute[75100]:     </nova:instance>
Nov 13 17:30:58 user nova-compute[75100]:   </metadata>
Nov 13 17:30:58 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:30:58 user nova-compute[75100]:     <system>
Nov 13 17:30:58 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:30:58 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:30:58 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:30:58 user nova-compute[75100]:       <entry name="serial">73c5d863-7cae-481f-b8ea-dfc217514658</entry>
Nov 13 17:30:58 user nova-compute[75100]:       <entry name="uuid">73c5d863-7cae-481f-b8ea-dfc217514658</entry>
Nov 13 17:30:58 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:30:58 user nova-compute[75100]:     </system>
Nov 13 17:30:58 user nova-compute[75100]:   </sysinfo>
Nov 13 17:30:58 user nova-compute[75100]:   <os>
Nov 13 17:30:58 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:30:58 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:30:58 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:30:58 user nova-compute[75100]:   </os>
Nov 13 17:30:58 user nova-compute[75100]:   <features>
Nov 13 17:30:58 user nova-compute[75100]:     <acpi/>
Nov 13 17:30:58 user nova-compute[75100]:     <apic/>
Nov 13 17:30:58 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:30:58 user nova-compute[75100]:   </features>
Nov 13 17:30:58 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:30:58 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:30:58 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:30:58 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:30:58 user nova-compute[75100]:   </clock>
Nov 13 17:30:58 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:30:58 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:30:58 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:30:58 user nova-compute[75100]:   </cpu>
Nov 13 17:30:58 user nova-compute[75100]:   <devices>
Nov 13 17:30:58 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:30:58 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:30:58 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 13 17:30:58 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:30:58 user nova-compute[75100]:       <serial>b6f577ba-2aaa-4622-8530-3e5461d39c23</serial>
Nov 13 17:30:58 user nova-compute[75100]:     </disk>
Nov 13 17:30:58 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:30:58 user nova-compute[75100]:       <mac address="fa:16:3e:e9:c5:34"/>
Nov 13 17:30:58 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:30:58 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:30:58 user nova-compute[75100]:       <target dev="tapabbcd619-e7"/>
Nov 13 17:30:58 user nova-compute[75100]:     </interface>
Nov 13 17:30:58 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:30:58 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/73c5d863-7cae-481f-b8ea-dfc217514658/console.log" append="off"/>
Nov 13 17:30:58 user nova-compute[75100]:     </serial>
Nov 13 17:30:58 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:30:58 user nova-compute[75100]:     <video>
Nov 13 17:30:58 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:30:58 user nova-compute[75100]:     </video>
Nov 13 17:30:58 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:30:58 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:30:58 user nova-compute[75100]:     </rng>
Nov 13 17:30:58 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:30:58 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:30:58 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:30:58 user nova-compute[75100]:     </memballoon>
Nov 13 17:30:58 user nova-compute[75100]:   </devices>
Nov 13 17:30:58 user nova-compute[75100]: </domain>
Nov 13 17:30:58 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-95005404',display_name='tempest-ServerActionsTestOtherA-server-95005404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-95005404',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArXX8H/F/4k/bCD26MQyJfYc6kVyijAa21ATX3s9SJ4y/SgOLDqvjWXABytQ7Y0rezN8922Yqg0PmzPzy90j9+erJSCwuQJnigd+guQkVWmuyFrLUQ16eK1oB+ijXr+Rw==',key_name='tempest-keypair-216019137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-g1hxuk35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:30:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=73c5d863-7cae-481f-b8ea-dfc217514658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG os_vif [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95c73e75-70fd-5399-afc6-e58b7a602b58', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-a17ea6ff-784d-496d-b629-9ae043e7cefe req-45de07de-9785-4e0a-a342-b36eac338408 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Received event network-vif-plugged-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a17ea6ff-784d-496d-b629-9ae043e7cefe req-45de07de-9785-4e0a-a342-b36eac338408 service nova] Acquiring lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a17ea6ff-784d-496d-b629-9ae043e7cefe req-45de07de-9785-4e0a-a342-b36eac338408 service nova] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a17ea6ff-784d-496d-b629-9ae043e7cefe req-45de07de-9785-4e0a-a342-b36eac338408 service nova] Lock "d4f158c3-bcd5-4d5b-8c70-04726b17081a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-a17ea6ff-784d-496d-b629-9ae043e7cefe req-45de07de-9785-4e0a-a342-b36eac338408 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] No waiting events found dispatching network-vif-plugged-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:30:58 user nova-compute[75100]: WARNING nova.compute.manager [req-a17ea6ff-784d-496d-b629-9ae043e7cefe req-45de07de-9785-4e0a-a342-b36eac338408 service nova] [instance: d4f158c3-bcd5-4d5b-8c70-04726b17081a] Received unexpected event network-vif-plugged-a8f33ad4-03cc-4458-b977-d8db6b1aeb30 for instance with vm_state deleted and task_state None.
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabbcd619-e7, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabbcd619-e7, col_values=(('qos', UUID('d9c809dc-2b72-482a-aace-d5be1018ecd5')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabbcd619-e7, col_values=(('external_ids', {'iface-id': 'abbcd619-e7dc-4dd0-b1a4-4c542462c321', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:c5:34', 'vm-uuid': '73c5d863-7cae-481f-b8ea-dfc217514658'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:30:58 user nova-compute[75100]: INFO os_vif [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7')
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:30:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No VIF found with MAC fa:16:3e:e9:c5:34, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:31:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-66127cb7-740a-4038-b749-e018edfb7b6b req-cac4af9c-b4c3-4aae-a4d9-3f171865fdc4 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received event network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-66127cb7-740a-4038-b749-e018edfb7b6b req-cac4af9c-b4c3-4aae-a4d9-3f171865fdc4 service nova] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-66127cb7-740a-4038-b749-e018edfb7b6b req-cac4af9c-b4c3-4aae-a4d9-3f171865fdc4 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-66127cb7-740a-4038-b749-e018edfb7b6b req-cac4af9c-b4c3-4aae-a4d9-3f171865fdc4 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-66127cb7-740a-4038-b749-e018edfb7b6b req-cac4af9c-b4c3-4aae-a4d9-3f171865fdc4 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] No waiting events found dispatching network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:31:00 user nova-compute[75100]: WARNING nova.compute.manager [req-66127cb7-740a-4038-b749-e018edfb7b6b req-cac4af9c-b4c3-4aae-a4d9-3f171865fdc4 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received unexpected event network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 for instance with vm_state building and task_state spawning.
Nov 13 17:31:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-d063ffac-dd73-4b94-ae0e-e161486c8bc3 req-58267532-76f8-4f85-8c11-ccb21a95941f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-changed-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-d063ffac-dd73-4b94-ae0e-e161486c8bc3 req-58267532-76f8-4f85-8c11-ccb21a95941f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Refreshing instance network info cache due to event network-changed-0e4ff1c7-53c8-45ff-818e-03d897b1e954. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:31:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d063ffac-dd73-4b94-ae0e-e161486c8bc3 req-58267532-76f8-4f85-8c11-ccb21a95941f service nova] Acquiring lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:31:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d063ffac-dd73-4b94-ae0e-e161486c8bc3 req-58267532-76f8-4f85-8c11-ccb21a95941f service nova] Acquired lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:31:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-d063ffac-dd73-4b94-ae0e-e161486c8bc3 req-58267532-76f8-4f85-8c11-ccb21a95941f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Refreshing network info cache for port 0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:31:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Instance spawned successfully.
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-d7b95789-19a3-48df-a223-32827cc13742 req-41414565-75a8-4cd1-9945-f1f119cc71c0 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received event network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d7b95789-19a3-48df-a223-32827cc13742 req-41414565-75a8-4cd1-9945-f1f119cc71c0 service nova] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d7b95789-19a3-48df-a223-32827cc13742 req-41414565-75a8-4cd1-9945-f1f119cc71c0 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d7b95789-19a3-48df-a223-32827cc13742 req-41414565-75a8-4cd1-9945-f1f119cc71c0 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-d7b95789-19a3-48df-a223-32827cc13742 req-41414565-75a8-4cd1-9945-f1f119cc71c0 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] No waiting events found dispatching network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:31:02 user nova-compute[75100]: WARNING nova.compute.manager [req-d7b95789-19a3-48df-a223-32827cc13742 req-41414565-75a8-4cd1-9945-f1f119cc71c0 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received unexpected event network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 for instance with vm_state building and task_state spawning.
Nov 13 17:31:02 user nova-compute[75100]: INFO nova.compute.manager [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-d063ffac-dd73-4b94-ae0e-e161486c8bc3 req-58267532-76f8-4f85-8c11-ccb21a95941f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updated VIF entry in instance network info cache for port 0e4ff1c7-53c8-45ff-818e-03d897b1e954. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.network.neutron [req-d063ffac-dd73-4b94-ae0e-e161486c8bc3 req-58267532-76f8-4f85-8c11-ccb21a95941f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updating instance_info_cache with network_info: [{"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d063ffac-dd73-4b94-ae0e-e161486c8bc3 req-58267532-76f8-4f85-8c11-ccb21a95941f service nova] Releasing lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:31:02 user nova-compute[75100]: INFO nova.compute.manager [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Took 10.59 seconds to build instance.
Nov 13 17:31:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4e008db3-5c06-4167-901a-a5f1409b1743 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "73c5d863-7cae-481f-b8ea-dfc217514658" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.692s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:31:02 user nova-compute[75100]: INFO nova.compute.manager [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] instance snapshotting
Nov 13 17:31:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Beginning live snapshot process
Nov 13 17:31:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json -f qcow2" returned: 0 in 0.233s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz6oo5anp/95b036bd53c2499e94303516f6d105ca.delta 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz6oo5anp/95b036bd53c2499e94303516f6d105ca.delta 1073741824" returned: 0 in 0.054s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 17:31:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:31:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] COPY block job progress, current cursor: 25100288 final cursor: 75563008 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:31:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:31:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 17:31:05 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:31:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz6oo5anp/95b036bd53c2499e94303516f6d105ca.delta /opt/stack/data/nova/instances/snapshots/tmpz6oo5anp/95b036bd53c2499e94303516f6d105ca {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz6oo5anp/95b036bd53c2499e94303516f6d105ca.delta /opt/stack/data/nova/instances/snapshots/tmpz6oo5anp/95b036bd53c2499e94303516f6d105ca" returned: 0 in 0.558s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Snapshot extracted, beginning image upload
Nov 13 17:31:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:09 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Snapshot image upload complete
Nov 13 17:31:09 user nova-compute[75100]: INFO nova.compute.manager [None req-e55cec06-acfb-4d26-b441-054bb7704754 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Took 6.21 seconds to snapshot the instance on the hypervisor.
Nov 13 17:31:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:31:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:31:17 user nova-compute[75100]: INFO nova.compute.claims [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Claim successful on node user
Nov 13 17:31:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:17 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:31:17 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:31:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:31:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:31:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG nova.policy [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '421484d1f180498fa5e078c084d70986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bd8fd1a36f49a08be3d97799e847a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:31:18 user nova-compute[75100]: INFO nova.virt.block_device [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Booting with volume cae63b19-8572-4771-901c-07d61731cd22 at /dev/vda
Nov 13 17:31:18 user nova-compute[75100]: DEBUG os_brick.utils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a2d506-6f19-485c-8d59-cbda1437b80d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffbd39c-ff12-4c81-a1d8-e2e23b12b41d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c084798-7afb-4828-b2fa-8445fe6addc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deaa147-5d82-418b-9a30-002fd7b9013b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:31:18 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:31:18 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[97444e06-f04c-4779-9521-1888b8e12a7a]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG os_brick.utils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Updating existing volume attachment record: a0e60303-82a3-4279-ae28-96de502a8c1b {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Successfully created port: f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:31:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Successfully updated port: f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:31:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "refresh_cache-8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:31:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquired lock "refresh_cache-8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:31:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:31:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-7f198466-13b0-4a39-a649-0429a422c36a req-58f2bcb4-8b14-434f-91c2-efb0dc13ff33 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-changed-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-7f198466-13b0-4a39-a649-0429a422c36a req-58f2bcb4-8b14-434f-91c2-efb0dc13ff33 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Refreshing instance network info cache due to event network-changed-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:31:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7f198466-13b0-4a39-a649-0429a422c36a req-58f2bcb4-8b14-434f-91c2-efb0dc13ff33 service nova] Acquiring lock "refresh_cache-8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:31:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:31:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Updating instance_info_cache with network_info: [{"id": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "address": "fa:16:3e:9e:88:54", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a85f7-5b", "ovs_interfaceid": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:31:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Releasing lock "refresh_cache-8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:31:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Instance network_info: |[{"id": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "address": "fa:16:3e:9e:88:54", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a85f7-5b", "ovs_interfaceid": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:31:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7f198466-13b0-4a39-a649-0429a422c36a req-58f2bcb4-8b14-434f-91c2-efb0dc13ff33 service nova] Acquired lock "refresh_cache-8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:31:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-7f198466-13b0-4a39-a649-0429a422c36a req-58f2bcb4-8b14-434f-91c2-efb0dc13ff33 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Refreshing network info cache for port f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:31:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-7f198466-13b0-4a39-a649-0429a422c36a req-58f2bcb4-8b14-434f-91c2-efb0dc13ff33 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Updated VIF entry in instance network info cache for port f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:31:21 user nova-compute[75100]: DEBUG nova.network.neutron [req-7f198466-13b0-4a39-a649-0429a422c36a req-58f2bcb4-8b14-434f-91c2-efb0dc13ff33 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Updating instance_info_cache with network_info: [{"id": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "address": "fa:16:3e:9e:88:54", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a85f7-5b", "ovs_interfaceid": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:31:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7f198466-13b0-4a39-a649-0429a422c36a req-58f2bcb4-8b14-434f-91c2-efb0dc13ff33 service nova] Releasing lock "refresh_cache-8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:31:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:31:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:31:21 user nova-compute[75100]: INFO nova.compute.claims [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Claim successful on node user
Nov 13 17:31:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:31:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:31:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG nova.policy [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ba71ec67c664e94a71cc9f9107303a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca12c426d0c495b80b77b8ae26be4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:31:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Creating image(s)
Nov 13 17:31:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "/opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "/opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "b728af2a36dfc0004715060419be4d06a853e525" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "b728af2a36dfc0004715060419be4d06a853e525" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Successfully created port: 3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525.part --force-share --output=json" returned: 0 in 0.199s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.images [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] f54422c8-8a7d-4261-92b2-7a48a86048b0 was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525.part /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:31:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Creating image(s)
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Ensure instance console log exists: /opt/stack/data/nova/instances/8fd42f7b-9df1-4b39-9df9-eddcd5c79c23/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Start _get_guest_xml network_info=[{"id": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "address": "fa:16:3e:9e:88:54", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a85f7-5b", "ovs_interfaceid": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'a0e60303-82a3-4279-ae28-96de502a8c1b', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJYlfmHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8fd42f7b-9df1-4b39-9df9-eddcd5c79c23', 'attached_at': '', 'detached_at': '', 'volume_id': 'cae63b19-8572-4771-901c-07d61731cd22', 'serial': 'cae63b19-8572-4771-901c-07d61731cd22'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:31:23 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:31:23 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJYlfmHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:31:23 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:31:23 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:31:23 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaf31b2-786a-4537-884a-22030870305d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:31:23 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d865e703-205c-4893-bd35-3ac3de26665d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22] added
Nov 13 17:31:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c652d31-4d66-43a4-9142-4a3f3c14d662]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8da328-03e1-40f8-b15b-772190c3de9d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJYlfmHU {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJYlfmHU" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e650a75-dbba-4e2a-988a-e3db8e11e013]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJYlfmHU'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5968146f-9d27-4d54-a2d9-d755474d0633]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[20442dff-f778-48bb-b474-f52c2866b80a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525.part /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525.converted" returned: 0 in 0.404s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6b3686-ebc7-40a2-b1f3-26f90624a585]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260]
Nov 13 17:31:23 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260] successful.
Nov 13 17:31:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2bb6e4-5448-4618-b91c-d7a759d80711]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[855bd641-7653-4aca-8f33-1530c5aa8bc2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:31:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Successfully updated port: 3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b8fa42-60ad-4dee-b727-b431212b3105]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJYlfmHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquired lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-6b89c261-fea6-4d16-a6ab-275b51eaf6bd req-8b3bee38-716f-417c-8c14-27df584ee28f service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-changed-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-6b89c261-fea6-4d16-a6ab-275b51eaf6bd req-8b3bee38-716f-417c-8c14-27df584ee28f service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Refreshing instance network info cache due to event network-changed-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6b89c261-fea6-4d16-a6ab-275b51eaf6bd req-8b3bee38-716f-417c-8c14-27df584ee28f service nova] Acquiring lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "b728af2a36dfc0004715060419be4d06a853e525" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.182s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:23 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525 --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "b728af2a36dfc0004715060419be4d06a853e525" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "b728af2a36dfc0004715060419be4d06a853e525" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updating instance_info_cache with network_info: [{"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Releasing lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Instance network_info: |[{"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6b89c261-fea6-4d16-a6ab-275b51eaf6bd req-8b3bee38-716f-417c-8c14-27df584ee28f service nova] Acquired lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-6b89c261-fea6-4d16-a6ab-275b51eaf6bd req-8b3bee38-716f-417c-8c14-27df584ee28f service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Refreshing network info cache for port 3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525 --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525,backing_fmt=raw /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525,backing_fmt=raw /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk 1073741824" returned: 0 in 0.046s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "b728af2a36dfc0004715060419be4d06a853e525" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525 --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-6b89c261-fea6-4d16-a6ab-275b51eaf6bd req-8b3bee38-716f-417c-8c14-27df584ee28f service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updated VIF entry in instance network info cache for port 3f5b2945-ec9f-48e7-ada2-3c0cce2f8271. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-6b89c261-fea6-4d16-a6ab-275b51eaf6bd req-8b3bee38-716f-417c-8c14-27df584ee28f service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updating instance_info_cache with network_info: [{"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6b89c261-fea6-4d16-a6ab-275b51eaf6bd req-8b3bee38-716f-417c-8c14-27df584ee28f service nova] Releasing lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Cannot resize image /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Ensure instance console log exists: /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Start _get_guest_xml network_info=[{"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:31:19Z,direct_url=<?>,disk_format='qcow2',id=f54422c8-8a7d-4261-92b2-7a48a86048b0,min_disk=0,min_ram=0,name='tempest-scenario-img--1398738023',owner='dca12c426d0c495b80b77b8ae26be4eb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:31:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'f54422c8-8a7d-4261-92b2-7a48a86048b0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:31:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:31:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:31:19Z,direct_url=<?>,disk_format='qcow2',id=f54422c8-8a7d-4261-92b2-7a48a86048b0,min_disk=0,min_ram=0,name='tempest-scenario-img--1398738023',owner='dca12c426d0c495b80b77b8ae26be4eb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:31:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1606415269',display_name='tempest-TestMinimumBasicScenario-server-1606415269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1606415269',id=31,image_ref='f54422c8-8a7d-4261-92b2-7a48a86048b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbFqeEjBCfPtchoBTJKqBMlcdgUsNVL+XmYOfHVgKSjpw6C8LgkXx5dtm92oBIN3q6lU1BKohKSabIcLqYDIWoqeuTkgxt+/aS5wfehrXw5XF1uomKZNkQcH7ewifI6Rw==',key_name='tempest-TestMinimumBasicScenario-754296732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca12c426d0c495b80b77b8ae26be4eb',ramdisk_id='',reservation_id='r-7oh5r93s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f54422c8-8a7d-4261-92b2-7a48a86048b0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1769966982',owner_user_name='tempest-TestMinimumBasicScenario-1769966982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:31:23Z,user_data=None,user_id='2ba71ec67c664e94a71cc9f9107303a5',uuid=a5f308a2-3b44-476e-85ab-15e1bf107968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converting VIF {"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'pci_devices' on Instance uuid a5f308a2-3b44-476e-85ab-15e1bf107968 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:31:24 user nova-compute[75100]:   <uuid>a5f308a2-3b44-476e-85ab-15e1bf107968</uuid>
Nov 13 17:31:24 user nova-compute[75100]:   <name>instance-0000001f</name>
Nov 13 17:31:24 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:31:24 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:31:24 user nova-compute[75100]:   <metadata>
Nov 13 17:31:24 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:31:24 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:31:24 user nova-compute[75100]:       <nova:name>tempest-TestMinimumBasicScenario-server-1606415269</nova:name>
Nov 13 17:31:24 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:31:24</nova:creationTime>
Nov 13 17:31:24 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:31:24 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:31:24 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:31:24 user nova-compute[75100]:       <nova:owner>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:user uuid="2ba71ec67c664e94a71cc9f9107303a5">tempest-TestMinimumBasicScenario-1769966982-project-member</nova:user>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:project uuid="dca12c426d0c495b80b77b8ae26be4eb">tempest-TestMinimumBasicScenario-1769966982</nova:project>
Nov 13 17:31:24 user nova-compute[75100]:       </nova:owner>
Nov 13 17:31:24 user nova-compute[75100]:       <nova:root type="image" uuid="f54422c8-8a7d-4261-92b2-7a48a86048b0"/>
Nov 13 17:31:24 user nova-compute[75100]:       <nova:ports>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:port uuid="3f5b2945-ec9f-48e7-ada2-3c0cce2f8271">
Nov 13 17:31:24 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:31:24 user nova-compute[75100]:         </nova:port>
Nov 13 17:31:24 user nova-compute[75100]:       </nova:ports>
Nov 13 17:31:24 user nova-compute[75100]:     </nova:instance>
Nov 13 17:31:24 user nova-compute[75100]:   </metadata>
Nov 13 17:31:24 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:31:24 user nova-compute[75100]:     <system>
Nov 13 17:31:24 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:31:24 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:31:24 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:31:24 user nova-compute[75100]:       <entry name="serial">a5f308a2-3b44-476e-85ab-15e1bf107968</entry>
Nov 13 17:31:24 user nova-compute[75100]:       <entry name="uuid">a5f308a2-3b44-476e-85ab-15e1bf107968</entry>
Nov 13 17:31:24 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:31:24 user nova-compute[75100]:     </system>
Nov 13 17:31:24 user nova-compute[75100]:   </sysinfo>
Nov 13 17:31:24 user nova-compute[75100]:   <os>
Nov 13 17:31:24 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:31:24 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:31:24 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:31:24 user nova-compute[75100]:   </os>
Nov 13 17:31:24 user nova-compute[75100]:   <features>
Nov 13 17:31:24 user nova-compute[75100]:     <acpi/>
Nov 13 17:31:24 user nova-compute[75100]:     <apic/>
Nov 13 17:31:24 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:31:24 user nova-compute[75100]:   </features>
Nov 13 17:31:24 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:31:24 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:31:24 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:31:24 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:31:24 user nova-compute[75100]:   </clock>
Nov 13 17:31:24 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:31:24 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:31:24 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:31:24 user nova-compute[75100]:   </cpu>
Nov 13 17:31:24 user nova-compute[75100]:   <devices>
Nov 13 17:31:24 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:31:24 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:31:24 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk"/>
Nov 13 17:31:24 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:31:24 user nova-compute[75100]:     </disk>
Nov 13 17:31:24 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:31:24 user nova-compute[75100]:       <mac address="fa:16:3e:e4:03:2a"/>
Nov 13 17:31:24 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:31:24 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:31:24 user nova-compute[75100]:       <target dev="tap3f5b2945-ec"/>
Nov 13 17:31:24 user nova-compute[75100]:     </interface>
Nov 13 17:31:24 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:31:24 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/console.log" append="off"/>
Nov 13 17:31:24 user nova-compute[75100]:     </serial>
Nov 13 17:31:24 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:31:24 user nova-compute[75100]:     <video>
Nov 13 17:31:24 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:31:24 user nova-compute[75100]:     </video>
Nov 13 17:31:24 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:31:24 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:31:24 user nova-compute[75100]:     </rng>
Nov 13 17:31:24 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:31:24 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:31:24 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:31:24 user nova-compute[75100]:     </memballoon>
Nov 13 17:31:24 user nova-compute[75100]:   </devices>
Nov 13 17:31:24 user nova-compute[75100]: </domain>
Nov 13 17:31:24 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1606415269',display_name='tempest-TestMinimumBasicScenario-server-1606415269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1606415269',id=31,image_ref='f54422c8-8a7d-4261-92b2-7a48a86048b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbFqeEjBCfPtchoBTJKqBMlcdgUsNVL+XmYOfHVgKSjpw6C8LgkXx5dtm92oBIN3q6lU1BKohKSabIcLqYDIWoqeuTkgxt+/aS5wfehrXw5XF1uomKZNkQcH7ewifI6Rw==',key_name='tempest-TestMinimumBasicScenario-754296732',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca12c426d0c495b80b77b8ae26be4eb',ramdisk_id='',reservation_id='r-7oh5r93s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f54422c8-8a7d-4261-92b2-7a48a86048b0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1769966982',owner_user_name='tempest-TestMinimumBasicScenario-1769966982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:31:23Z,user_data=None,user_id='2ba71ec67c664e94a71cc9f9107303a5',uuid=a5f308a2-3b44-476e-85ab-15e1bf107968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converting VIF {"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG os_vif [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c38fe3b-e86f-589c-9fe5-db62bbffccf8', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f5b2945-ec, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f5b2945-ec, col_values=(('qos', UUID('ad30f594-1c34-45a8-91b4-e1bc570fa7b4')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f5b2945-ec, col_values=(('external_ids', {'iface-id': '3f5b2945-ec9f-48e7-ada2-3c0cce2f8271', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:03:2a', 'vm-uuid': 'a5f308a2-3b44-476e-85ab-15e1bf107968'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:24 user nova-compute[75100]: INFO os_vif [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec')
Nov 13 17:31:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23731353363643863', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731353363643863', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] No VIF found with MAC fa:16:3e:e4:03:2a, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-733714488',display_name='tempest-TestVolumeBootPattern-server-733714488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-733714488',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+NtN2Z5kT0TQJbfKGQsJyKiPak8bepWgNcLUPGujC+AXoGWK840LLNYNacMdPigyvVLHhv89mM2IBFpbgvf3ZqImVEZSa6YyJUnBkkWfhyP+tfJPZtUfdOTGbNpjZ7sA==',key_name='tempest-TestVolumeBootPattern-2052596683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-w71hp4hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:31:18Z,user_data=None,user_id='421484d1f180498fa5e078c084d70986',uuid=8fd42f7b-9df1-4b39-9df9-eddcd5c79c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "address": "fa:16:3e:9e:88:54", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a85f7-5b", "ovs_interfaceid": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "address": "fa:16:3e:9e:88:54", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a85f7-5b", "ovs_interfaceid": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:88:54,bridge_name='br-int',has_traffic_filtering=True,id=f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf51a85f7-5b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:31:24 user nova-compute[75100]:   <uuid>8fd42f7b-9df1-4b39-9df9-eddcd5c79c23</uuid>
Nov 13 17:31:24 user nova-compute[75100]:   <name>instance-0000001e</name>
Nov 13 17:31:24 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:31:24 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:31:24 user nova-compute[75100]:   <metadata>
Nov 13 17:31:24 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:31:24 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:31:24 user nova-compute[75100]:       <nova:name>tempest-TestVolumeBootPattern-server-733714488</nova:name>
Nov 13 17:31:24 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:31:23</nova:creationTime>
Nov 13 17:31:24 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:31:24 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:31:24 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:31:24 user nova-compute[75100]:       <nova:owner>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:user uuid="421484d1f180498fa5e078c084d70986">tempest-TestVolumeBootPattern-1156978750-project-member</nova:user>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:project uuid="20bd8fd1a36f49a08be3d97799e847a8">tempest-TestVolumeBootPattern-1156978750</nova:project>
Nov 13 17:31:24 user nova-compute[75100]:       </nova:owner>
Nov 13 17:31:24 user nova-compute[75100]:       <nova:ports>
Nov 13 17:31:24 user nova-compute[75100]:         <nova:port uuid="f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2">
Nov 13 17:31:24 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 17:31:24 user nova-compute[75100]:         </nova:port>
Nov 13 17:31:24 user nova-compute[75100]:       </nova:ports>
Nov 13 17:31:24 user nova-compute[75100]:     </nova:instance>
Nov 13 17:31:24 user nova-compute[75100]:   </metadata>
Nov 13 17:31:24 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:31:24 user nova-compute[75100]:     <system>
Nov 13 17:31:24 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:31:24 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:31:24 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:31:24 user nova-compute[75100]:       <entry name="serial">8fd42f7b-9df1-4b39-9df9-eddcd5c79c23</entry>
Nov 13 17:31:24 user nova-compute[75100]:       <entry name="uuid">8fd42f7b-9df1-4b39-9df9-eddcd5c79c23</entry>
Nov 13 17:31:24 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:31:24 user nova-compute[75100]:     </system>
Nov 13 17:31:24 user nova-compute[75100]:   </sysinfo>
Nov 13 17:31:24 user nova-compute[75100]:   <os>
Nov 13 17:31:24 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:31:24 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:31:24 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:31:24 user nova-compute[75100]:   </os>
Nov 13 17:31:24 user nova-compute[75100]:   <features>
Nov 13 17:31:24 user nova-compute[75100]:     <acpi/>
Nov 13 17:31:24 user nova-compute[75100]:     <apic/>
Nov 13 17:31:24 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:31:24 user nova-compute[75100]:   </features>
Nov 13 17:31:24 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:31:24 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:31:24 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:31:24 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:31:24 user nova-compute[75100]:   </clock>
Nov 13 17:31:24 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:31:24 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:31:24 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:31:24 user nova-compute[75100]:   </cpu>
Nov 13 17:31:24 user nova-compute[75100]:   <devices>
Nov 13 17:31:24 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:31:24 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:31:24 user nova-compute[75100]:       <source dev="/dev/sdd"/>
Nov 13 17:31:24 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:31:24 user nova-compute[75100]:       <serial>cae63b19-8572-4771-901c-07d61731cd22</serial>
Nov 13 17:31:24 user nova-compute[75100]:     </disk>
Nov 13 17:31:24 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:31:24 user nova-compute[75100]:       <mac address="fa:16:3e:9e:88:54"/>
Nov 13 17:31:24 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:31:24 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:31:24 user nova-compute[75100]:       <target dev="tapf51a85f7-5b"/>
Nov 13 17:31:24 user nova-compute[75100]:     </interface>
Nov 13 17:31:24 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:31:24 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/8fd42f7b-9df1-4b39-9df9-eddcd5c79c23/console.log" append="off"/>
Nov 13 17:31:24 user nova-compute[75100]:     </serial>
Nov 13 17:31:24 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:31:24 user nova-compute[75100]:     <video>
Nov 13 17:31:24 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:31:24 user nova-compute[75100]:     </video>
Nov 13 17:31:24 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:31:24 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:31:24 user nova-compute[75100]:     </rng>
Nov 13 17:31:24 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:31:24 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:31:24 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:31:24 user nova-compute[75100]:     </memballoon>
Nov 13 17:31:24 user nova-compute[75100]:   </devices>
Nov 13 17:31:24 user nova-compute[75100]: </domain>
Nov 13 17:31:24 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-733714488',display_name='tempest-TestVolumeBootPattern-server-733714488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-733714488',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+NtN2Z5kT0TQJbfKGQsJyKiPak8bepWgNcLUPGujC+AXoGWK840LLNYNacMdPigyvVLHhv89mM2IBFpbgvf3ZqImVEZSa6YyJUnBkkWfhyP+tfJPZtUfdOTGbNpjZ7sA==',key_name='tempest-TestVolumeBootPattern-2052596683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-w71hp4hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:31:18Z,user_data=None,user_id='421484d1f180498fa5e078c084d70986',uuid=8fd42f7b-9df1-4b39-9df9-eddcd5c79c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "address": "fa:16:3e:9e:88:54", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a85f7-5b", "ovs_interfaceid": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "address": "fa:16:3e:9e:88:54", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a85f7-5b", "ovs_interfaceid": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:88:54,bridge_name='br-int',has_traffic_filtering=True,id=f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf51a85f7-5b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG os_vif [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:88:54,bridge_name='br-int',has_traffic_filtering=True,id=f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf51a85f7-5b') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '236cb7d1-ed47-5d7d-a6dc-c8902b444971', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf51a85f7-5b, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf51a85f7-5b, col_values=(('qos', UUID('593b4add-17c7-4fdf-b3e1-ba7760ddce37')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf51a85f7-5b, col_values=(('external_ids', {'iface-id': 'f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:88:54', 'vm-uuid': '8fd42f7b-9df1-4b39-9df9-eddcd5c79c23'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:24 user nova-compute[75100]: INFO os_vif [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:88:54,bridge_name='br-int',has_traffic_filtering=True,id=f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf51a85f7-5b')
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:31:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] No VIF found with MAC fa:16:3e:9e:88:54, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:31:25 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:31:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:25 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:31:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-c052efb9-c723-4561-b2fa-f801f5f87c77 req-1fd9cb7c-85f7-40de-8b18-553bcc4ceab9 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c052efb9-c723-4561-b2fa-f801f5f87c77 req-1fd9cb7c-85f7-40de-8b18-553bcc4ceab9 service nova] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c052efb9-c723-4561-b2fa-f801f5f87c77 req-1fd9cb7c-85f7-40de-8b18-553bcc4ceab9 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c052efb9-c723-4561-b2fa-f801f5f87c77 req-1fd9cb7c-85f7-40de-8b18-553bcc4ceab9 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-c052efb9-c723-4561-b2fa-f801f5f87c77 req-1fd9cb7c-85f7-40de-8b18-553bcc4ceab9 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] No waiting events found dispatching network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:31:27 user nova-compute[75100]: WARNING nova.compute.manager [req-c052efb9-c723-4561-b2fa-f801f5f87c77 req-1fd9cb7c-85f7-40de-8b18-553bcc4ceab9 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received unexpected event network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 for instance with vm_state building and task_state spawning.
Nov 13 17:31:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:31:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] No waiting events found dispatching network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:31:29 user nova-compute[75100]: WARNING nova.compute.manager [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received unexpected event network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 for instance with vm_state building and task_state spawning.
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] Acquiring lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] No waiting events found dispatching network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:31:29 user nova-compute[75100]: WARNING nova.compute.manager [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received unexpected event network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 for instance with vm_state building and task_state spawning.
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] Acquiring lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] No waiting events found dispatching network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:31:29 user nova-compute[75100]: WARNING nova.compute.manager [req-6ea6882a-e008-40e4-a492-c1577d3ebd40 req-c8d4b22a-9b24-450c-88b6-89a0f0f61463 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received unexpected event network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 for instance with vm_state building and task_state spawning.
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:31:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Instance spawned successfully.
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Instance spawned successfully.
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:31:29 user nova-compute[75100]: INFO nova.compute.manager [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Took 7.13 seconds to spawn the instance on the hypervisor.
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:31:29 user nova-compute[75100]: INFO nova.compute.manager [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Took 6.50 seconds to spawn the instance on the hypervisor.
Nov 13 17:31:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:29 user nova-compute[75100]: INFO nova.compute.manager [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Took 7.91 seconds to build instance.
Nov 13 17:31:29 user nova-compute[75100]: INFO nova.compute.manager [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Took 12.44 seconds to build instance.
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5556bcfc-b514-43c9-bc55-96dd2316f3e6 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.011s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-74314a85-2353-419c-b8a3-5b3d8991850e tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.550s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:31:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:32 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:31:32 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:31:32 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7586MB free_disk=25.045242309570312GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:31:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d2c4575b-ef8d-4a9d-9650-459366b7227e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d30816f4-82ec-43b9-bd47-f34190e5c82f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance bcb48f07-30a1-48a1-b739-49bf2513c013 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 73c5d863-7cae-481f-b8ea-dfc217514658 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance a5f308a2-3b44-476e-85ab-15e1bf107968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:31:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:31:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:31:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:31:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:31:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:31:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:31:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Updating instance_info_cache with network_info: [{"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:31:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:31:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:31:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:31:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:31:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:31:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:31:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:31:42 user nova-compute[75100]: INFO nova.compute.manager [None req-d7c49b71-35b4-4021-96c5-c3d07e951108 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Unrescuing
Nov 13 17:31:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7c49b71-35b4-4021-96c5-c3d07e951108 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:31:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7c49b71-35b4-4021-96c5-c3d07e951108 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquired lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:31:42 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d7c49b71-35b4-4021-96c5-c3d07e951108 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:31:43 user nova-compute[75100]: DEBUG nova.network.neutron [None req-d7c49b71-35b4-4021-96c5-c3d07e951108 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updating instance_info_cache with network_info: [{"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:31:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d7c49b71-35b4-4021-96c5-c3d07e951108 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Releasing lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:31:43 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d7c49b71-35b4-4021-96c5-c3d07e951108 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'flavor' on Instance uuid d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:31:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-ad423e5a-f32e-4831-a930-0f2aa6fd4973 req-0fab1c6c-a0bc-4994-b135-b3d44868294c service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-unplugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ad423e5a-f32e-4831-a930-0f2aa6fd4973 req-0fab1c6c-a0bc-4994-b135-b3d44868294c service nova] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ad423e5a-f32e-4831-a930-0f2aa6fd4973 req-0fab1c6c-a0bc-4994-b135-b3d44868294c service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ad423e5a-f32e-4831-a930-0f2aa6fd4973 req-0fab1c6c-a0bc-4994-b135-b3d44868294c service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-ad423e5a-f32e-4831-a930-0f2aa6fd4973 req-0fab1c6c-a0bc-4994-b135-b3d44868294c service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] No waiting events found dispatching network-vif-unplugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:31:43 user nova-compute[75100]: WARNING nova.compute.manager [req-ad423e5a-f32e-4831-a930-0f2aa6fd4973 req-0fab1c6c-a0bc-4994-b135-b3d44868294c service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received unexpected event network-vif-unplugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:31:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Instance destroyed successfully.
Nov 13 17:31:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] No waiting events found dispatching network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:31:45 user nova-compute[75100]: WARNING nova.compute.manager [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received unexpected event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:31:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] No waiting events found dispatching network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:31:45 user nova-compute[75100]: WARNING nova.compute.manager [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received unexpected event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:31:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] No waiting events found dispatching network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:31:45 user nova-compute[75100]: WARNING nova.compute.manager [req-99d09bc6-59ec-4562-a4bb-61c70819d8d9 req-bcbea649-108f-4049-8650-28093dc831fc service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received unexpected event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:31:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d7c49b71-35b4-4021-96c5-c3d07e951108 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:31:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:31:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:31:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:31:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:31:49 user nova-compute[75100]: INFO nova.compute.claims [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Claim successful on node user
Nov 13 17:31:49 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:31:49 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:31:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:31:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:31:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:31:49 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:31:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:31:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:31:50 user nova-compute[75100]: DEBUG nova.policy [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77f5fd132c0e46438884eaffae0beab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf7bde4b774e3dac46d41d32496efa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:31:50 user nova-compute[75100]: INFO nova.virt.block_device [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Booting with volume-backed-image 40ac832f-026d-4a87-87c5-ec47fa8f4825 at /dev/vda
Nov 13 17:31:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Successfully created port: ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:31:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Successfully updated port: ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:31:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "refresh_cache-3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:31:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquired lock "refresh_cache-3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:31:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:31:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-9a3ea390-f58f-4c3c-b7a0-adeecd13d74b req-6bd196ae-14c8-43b7-8625-45b728b8aa16 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-changed-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:31:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-9a3ea390-f58f-4c3c-b7a0-adeecd13d74b req-6bd196ae-14c8-43b7-8625-45b728b8aa16 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Refreshing instance network info cache due to event network-changed-ba1c3e90-566f-4b88-8f8c-1b100eea3621. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:31:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a3ea390-f58f-4c3c-b7a0-adeecd13d74b req-6bd196ae-14c8-43b7-8625-45b728b8aa16 service nova] Acquiring lock "refresh_cache-3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:31:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:31:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Updating instance_info_cache with network_info: [{"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:31:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Releasing lock "refresh_cache-3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:31:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Instance network_info: |[{"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:31:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a3ea390-f58f-4c3c-b7a0-adeecd13d74b req-6bd196ae-14c8-43b7-8625-45b728b8aa16 service nova] Acquired lock "refresh_cache-3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:31:52 user nova-compute[75100]: DEBUG nova.network.neutron [req-9a3ea390-f58f-4c3c-b7a0-adeecd13d74b req-6bd196ae-14c8-43b7-8625-45b728b8aa16 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Refreshing network info cache for port ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:31:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:52 user nova-compute[75100]: DEBUG nova.network.neutron [req-9a3ea390-f58f-4c3c-b7a0-adeecd13d74b req-6bd196ae-14c8-43b7-8625-45b728b8aa16 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Updated VIF entry in instance network info cache for port ba1c3e90-566f-4b88-8f8c-1b100eea3621. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:31:52 user nova-compute[75100]: DEBUG nova.network.neutron [req-9a3ea390-f58f-4c3c-b7a0-adeecd13d74b req-6bd196ae-14c8-43b7-8625-45b728b8aa16 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Updating instance_info_cache with network_info: [{"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:31:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a3ea390-f58f-4c3c-b7a0-adeecd13d74b req-6bd196ae-14c8-43b7-8625-45b728b8aa16 service nova] Releasing lock "refresh_cache-3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:31:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:55 user nova-compute[75100]: DEBUG os_brick.utils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:31:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd0c89f-2458-4c72-a8ce-43d930a56aaa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35942ad-fd8a-4dcd-b3e3-3551a6b86a13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5b14fe-1a54-4e77-86d9-2a195f17d18e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b0dd5b-8db5-4dc4-9a64-92bb309c6c56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:31:56 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:31:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e66be6-8de5-4c0e-86e5-70df43df6eff]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG os_brick.utils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:31:56 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Updating existing volume attachment record: 0a2b63a7-7460-487d-96ec-e008e1854a1e {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:31:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:31:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:32:00 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Creating image(s)
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Ensure instance console log exists: /opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Start _get_guest_xml network_info=[{"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '0a2b63a7-7460-487d-96ec-e008e1854a1e', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXwpEWvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2', 'attached_at': '', 'detached_at': '', 'volume_id': '535e4944-841b-4ec9-bf5a-75871b15f6ea', 'serial': '535e4944-841b-4ec9-bf5a-75871b15f6ea'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:32:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:32:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXwpEWvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:32:00 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:32:00 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:32:00 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8b22b0-519d-42d3-8834-24c84410d89d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:32:00 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e001c954-2ae9-4369-9506-37c4f8657400]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea] added
Nov 13 17:32:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab335495-6707-4914-848c-c6a033230125]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[13799eb2-b793-48f0-8106-81b61b6a3683]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXwpEWvf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXwpEWvf" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b91e985-bc4f-4990-afcc-4d8864667411]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tXwpEWvf'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9953643c-260b-45d3-bf1f-2f97d46372fb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2948faf4-a4da-401d-bcd3-8cb6d775f6ee]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0a7d36-b3e2-425d-8afe-e1a563a698a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea, portal: 172.16.0.220,3260]
Nov 13 17:32:00 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea, portal: 172.16.0.220,3260] successful.
Nov 13 17:32:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[22240d89-8286-4fe9-8c41-0c69f582de0b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5dffc0-0cb2-4075-a423-1831aabbdab9]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:00 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:00 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26fe1e0-5378-43ef-a0bc-fdd0ad32a53a]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:00 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXwpEWvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26564356636356636', 'path': '/dev/sdf'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564356636356636', 'path': '/dev/sdf'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-651335238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-651335238',id=32,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-io0vancg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:31:50Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=ba1c3e90-566f-4b88-8f8c-1b100eea3621,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1c3e90-56') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:32:01 user nova-compute[75100]:   <uuid>3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2</uuid>
Nov 13 17:32:01 user nova-compute[75100]:   <name>instance-00000020</name>
Nov 13 17:32:01 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:32:01 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:32:01 user nova-compute[75100]:   <metadata>
Nov 13 17:32:01 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:32:01 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:32:01 user nova-compute[75100]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-651335238</nova:name>
Nov 13 17:32:01 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:32:00</nova:creationTime>
Nov 13 17:32:01 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:32:01 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:32:01 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:32:01 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:32:01 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:32:01 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:32:01 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:32:01 user nova-compute[75100]:       <nova:owner>
Nov 13 17:32:01 user nova-compute[75100]:         <nova:user uuid="77f5fd132c0e46438884eaffae0beab9">tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member</nova:user>
Nov 13 17:32:01 user nova-compute[75100]:         <nova:project uuid="f1bf7bde4b774e3dac46d41d32496efa">tempest-ServerBootFromVolumeStableRescueTest-1217233624</nova:project>
Nov 13 17:32:01 user nova-compute[75100]:       </nova:owner>
Nov 13 17:32:01 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:32:01 user nova-compute[75100]:       <nova:ports>
Nov 13 17:32:01 user nova-compute[75100]:         <nova:port uuid="ba1c3e90-566f-4b88-8f8c-1b100eea3621">
Nov 13 17:32:01 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:32:01 user nova-compute[75100]:         </nova:port>
Nov 13 17:32:01 user nova-compute[75100]:       </nova:ports>
Nov 13 17:32:01 user nova-compute[75100]:     </nova:instance>
Nov 13 17:32:01 user nova-compute[75100]:   </metadata>
Nov 13 17:32:01 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:32:01 user nova-compute[75100]:     <system>
Nov 13 17:32:01 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:32:01 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:32:01 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:32:01 user nova-compute[75100]:       <entry name="serial">3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2</entry>
Nov 13 17:32:01 user nova-compute[75100]:       <entry name="uuid">3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2</entry>
Nov 13 17:32:01 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:32:01 user nova-compute[75100]:     </system>
Nov 13 17:32:01 user nova-compute[75100]:   </sysinfo>
Nov 13 17:32:01 user nova-compute[75100]:   <os>
Nov 13 17:32:01 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:32:01 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:32:01 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:32:01 user nova-compute[75100]:   </os>
Nov 13 17:32:01 user nova-compute[75100]:   <features>
Nov 13 17:32:01 user nova-compute[75100]:     <acpi/>
Nov 13 17:32:01 user nova-compute[75100]:     <apic/>
Nov 13 17:32:01 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:32:01 user nova-compute[75100]:   </features>
Nov 13 17:32:01 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:32:01 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:32:01 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:32:01 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:32:01 user nova-compute[75100]:   </clock>
Nov 13 17:32:01 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:32:01 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:32:01 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:32:01 user nova-compute[75100]:   </cpu>
Nov 13 17:32:01 user nova-compute[75100]:   <devices>
Nov 13 17:32:01 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:32:01 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:32:01 user nova-compute[75100]:       <source dev="/dev/sdf"/>
Nov 13 17:32:01 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:32:01 user nova-compute[75100]:       <serial>535e4944-841b-4ec9-bf5a-75871b15f6ea</serial>
Nov 13 17:32:01 user nova-compute[75100]:     </disk>
Nov 13 17:32:01 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:32:01 user nova-compute[75100]:       <mac address="fa:16:3e:b0:5b:8d"/>
Nov 13 17:32:01 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:32:01 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:32:01 user nova-compute[75100]:       <target dev="tapba1c3e90-56"/>
Nov 13 17:32:01 user nova-compute[75100]:     </interface>
Nov 13 17:32:01 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:32:01 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/console.log" append="off"/>
Nov 13 17:32:01 user nova-compute[75100]:     </serial>
Nov 13 17:32:01 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:32:01 user nova-compute[75100]:     <video>
Nov 13 17:32:01 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:32:01 user nova-compute[75100]:     </video>
Nov 13 17:32:01 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:32:01 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:32:01 user nova-compute[75100]:     </rng>
Nov 13 17:32:01 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:32:01 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:32:01 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:32:01 user nova-compute[75100]:     </memballoon>
Nov 13 17:32:01 user nova-compute[75100]:   </devices>
Nov 13 17:32:01 user nova-compute[75100]: </domain>
Nov 13 17:32:01 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-651335238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-651335238',id=32,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-io0vancg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:31:50Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=ba1c3e90-566f-4b88-8f8c-1b100eea3621,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1c3e90-56') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG os_vif [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=ba1c3e90-566f-4b88-8f8c-1b100eea3621,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1c3e90-56') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31d49230-c0a8-5b53-af2f-04f3acdaf6e1', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba1c3e90-56, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba1c3e90-56, col_values=(('qos', UUID('adddd62d-05d8-40b3-8564-81a5320db764')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba1c3e90-56, col_values=(('external_ids', {'iface-id': 'ba1c3e90-566f-4b88-8f8c-1b100eea3621', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:5b:8d', 'vm-uuid': '3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:01 user nova-compute[75100]: INFO os_vif [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=ba1c3e90-566f-4b88-8f8c-1b100eea3621,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1c3e90-56')
Nov 13 17:32:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:32:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No VIF found with MAC fa:16:3e:b0:5b:8d, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:32:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-2463caca-a502-40c9-95e1-b265e2833f36 req-8ebd5656-0068-402c-828e-39300c9e3e36 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2463caca-a502-40c9-95e1-b265e2833f36 req-8ebd5656-0068-402c-828e-39300c9e3e36 service nova] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2463caca-a502-40c9-95e1-b265e2833f36 req-8ebd5656-0068-402c-828e-39300c9e3e36 service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2463caca-a502-40c9-95e1-b265e2833f36 req-8ebd5656-0068-402c-828e-39300c9e3e36 service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-2463caca-a502-40c9-95e1-b265e2833f36 req-8ebd5656-0068-402c-828e-39300c9e3e36 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] No waiting events found dispatching network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:32:03 user nova-compute[75100]: WARNING nova.compute.manager [req-2463caca-a502-40c9-95e1-b265e2833f36 req-8ebd5656-0068-402c-828e-39300c9e3e36 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received unexpected event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 for instance with vm_state building and task_state spawning.
Nov 13 17:32:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:32:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Instance spawned successfully.
Nov 13 17:32:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:32:05 user nova-compute[75100]: INFO nova.compute.manager [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 13 17:32:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-3910bbbd-f20b-4a97-b6c8-e308f646737f req-a9a7a7ba-8209-4742-95c4-e40b875d3d01 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3910bbbd-f20b-4a97-b6c8-e308f646737f req-a9a7a7ba-8209-4742-95c4-e40b875d3d01 service nova] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3910bbbd-f20b-4a97-b6c8-e308f646737f req-a9a7a7ba-8209-4742-95c4-e40b875d3d01 service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3910bbbd-f20b-4a97-b6c8-e308f646737f req-a9a7a7ba-8209-4742-95c4-e40b875d3d01 service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-3910bbbd-f20b-4a97-b6c8-e308f646737f req-a9a7a7ba-8209-4742-95c4-e40b875d3d01 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] No waiting events found dispatching network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:32:05 user nova-compute[75100]: WARNING nova.compute.manager [req-3910bbbd-f20b-4a97-b6c8-e308f646737f req-a9a7a7ba-8209-4742-95c4-e40b875d3d01 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received unexpected event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 for instance with vm_state building and task_state spawning.
Nov 13 17:32:05 user nova-compute[75100]: INFO nova.compute.manager [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Took 16.01 seconds to build instance.
Nov 13 17:32:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4fe1528c-f5b8-44eb-a6aa-29da786bd82a tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.122s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:11 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:32:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquired lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:32:11 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:32:11 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'info_cache' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:11 user nova-compute[75100]: DEBUG nova.objects.base [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.network.neutron [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Updating instance_info_cache with network_info: [{"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Releasing lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:32:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance destroyed successfully.
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'resources' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.objects.base [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-562088828',display_name='tempest-AttachVolumeTestJSON-server-562088828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-562088828',id=18,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0MMK9PR6LTDNy8k+1ome/7/JGCOaYN5Lt3qsENjyVjimlQSRra7KUpWuRZjUfo9P1bMI6EsGXlo4/Ypy8Z5ugzSg6hpliFDTFbfMjRXxyPD7FFbeVCCUZ1dM7RZ0z3bQ==',key_name='tempest-keypair-673460478',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='43327ade8a814488bb141835e2ac331b',ramdisk_id='',reservation_id='r-4p2x10pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2091682056',owner_user_name='tempest-AttachVolumeTestJSON-2091682056-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15122cbfe21b4775b679285eeb4beff7',uuid=d2c4575b-ef8d-4a9d-9650-459366b7227e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converting VIF {"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG os_vif [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bb5ab2c-fa, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85713acc-9dd2-4dee-b9ad-0e82fc72ec9b) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:32:12 user nova-compute[75100]: INFO os_vif [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa')
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Start _get_guest_xml network_info=[{"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'numa_topology' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.objects.base [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:32:12 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:32:12 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'vcpu_model' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.objects.base [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-562088828',display_name='tempest-AttachVolumeTestJSON-server-562088828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-562088828',id=18,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0MMK9PR6LTDNy8k+1ome/7/JGCOaYN5Lt3qsENjyVjimlQSRra7KUpWuRZjUfo9P1bMI6EsGXlo4/Ypy8Z5ugzSg6hpliFDTFbfMjRXxyPD7FFbeVCCUZ1dM7RZ0z3bQ==',key_name='tempest-keypair-673460478',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='43327ade8a814488bb141835e2ac331b',ramdisk_id='',reservation_id='r-4p2x10pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2091682056',owner_user_name='tempest-AttachVolumeTestJSON-2091682056-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15122cbfe21b4775b679285eeb4beff7',uuid=d2c4575b-ef8d-4a9d-9650-459366b7227e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converting VIF {"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'pci_devices' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.objects.base [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:32:12 user nova-compute[75100]:   <uuid>d2c4575b-ef8d-4a9d-9650-459366b7227e</uuid>
Nov 13 17:32:12 user nova-compute[75100]:   <name>instance-00000012</name>
Nov 13 17:32:12 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:32:12 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:32:12 user nova-compute[75100]:   <metadata>
Nov 13 17:32:12 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:32:12 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:32:12 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeTestJSON-server-562088828</nova:name>
Nov 13 17:32:12 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:32:12</nova:creationTime>
Nov 13 17:32:12 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:32:12 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:32:12 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:32:12 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:32:12 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:32:12 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:32:12 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:32:12 user nova-compute[75100]:       <nova:owner>
Nov 13 17:32:12 user nova-compute[75100]:         <nova:user uuid="15122cbfe21b4775b679285eeb4beff7">tempest-AttachVolumeTestJSON-2091682056-project-member</nova:user>
Nov 13 17:32:12 user nova-compute[75100]:         <nova:project uuid="43327ade8a814488bb141835e2ac331b">tempest-AttachVolumeTestJSON-2091682056</nova:project>
Nov 13 17:32:12 user nova-compute[75100]:       </nova:owner>
Nov 13 17:32:12 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:32:12 user nova-compute[75100]:       <nova:ports>
Nov 13 17:32:12 user nova-compute[75100]:         <nova:port uuid="0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd">
Nov 13 17:32:12 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 17:32:12 user nova-compute[75100]:         </nova:port>
Nov 13 17:32:12 user nova-compute[75100]:       </nova:ports>
Nov 13 17:32:12 user nova-compute[75100]:     </nova:instance>
Nov 13 17:32:12 user nova-compute[75100]:   </metadata>
Nov 13 17:32:12 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:32:12 user nova-compute[75100]:     <system>
Nov 13 17:32:12 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:32:12 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:32:12 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:32:12 user nova-compute[75100]:       <entry name="serial">d2c4575b-ef8d-4a9d-9650-459366b7227e</entry>
Nov 13 17:32:12 user nova-compute[75100]:       <entry name="uuid">d2c4575b-ef8d-4a9d-9650-459366b7227e</entry>
Nov 13 17:32:12 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:32:12 user nova-compute[75100]:     </system>
Nov 13 17:32:12 user nova-compute[75100]:   </sysinfo>
Nov 13 17:32:12 user nova-compute[75100]:   <os>
Nov 13 17:32:12 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:32:12 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:32:12 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:32:12 user nova-compute[75100]:   </os>
Nov 13 17:32:12 user nova-compute[75100]:   <features>
Nov 13 17:32:12 user nova-compute[75100]:     <acpi/>
Nov 13 17:32:12 user nova-compute[75100]:     <apic/>
Nov 13 17:32:12 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:32:12 user nova-compute[75100]:   </features>
Nov 13 17:32:12 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:32:12 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:32:12 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:32:12 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:32:12 user nova-compute[75100]:   </clock>
Nov 13 17:32:12 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:32:12 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:32:12 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:32:12 user nova-compute[75100]:   </cpu>
Nov 13 17:32:12 user nova-compute[75100]:   <devices>
Nov 13 17:32:12 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:32:12 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:32:12 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk"/>
Nov 13 17:32:12 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:32:12 user nova-compute[75100]:     </disk>
Nov 13 17:32:12 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:32:12 user nova-compute[75100]:       <mac address="fa:16:3e:00:52:b6"/>
Nov 13 17:32:12 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:32:12 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:32:12 user nova-compute[75100]:       <target dev="tap0bb5ab2c-fa"/>
Nov 13 17:32:12 user nova-compute[75100]:     </interface>
Nov 13 17:32:12 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:32:12 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/console.log" append="off"/>
Nov 13 17:32:12 user nova-compute[75100]:     </serial>
Nov 13 17:32:12 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:32:12 user nova-compute[75100]:     <video>
Nov 13 17:32:12 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:32:12 user nova-compute[75100]:     </video>
Nov 13 17:32:12 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:32:12 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:32:12 user nova-compute[75100]:     </rng>
Nov 13 17:32:12 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:32:12 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:32:12 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:32:12 user nova-compute[75100]:     </memballoon>
Nov 13 17:32:12 user nova-compute[75100]:   </devices>
Nov 13 17:32:12 user nova-compute[75100]: </domain>
Nov 13 17:32:12 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'trusted_certs' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.objects.base [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:32:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Cannot resize image /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'migration_context' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG nova.objects.base [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Object Instance<d2c4575b-ef8d-4a9d-9650-459366b7227e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-562088828',display_name='tempest-AttachVolumeTestJSON-server-562088828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-562088828',id=18,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0MMK9PR6LTDNy8k+1ome/7/JGCOaYN5Lt3qsENjyVjimlQSRra7KUpWuRZjUfo9P1bMI6EsGXlo4/Ypy8Z5ugzSg6hpliFDTFbfMjRXxyPD7FFbeVCCUZ1dM7RZ0z3bQ==',key_name='tempest-keypair-673460478',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='43327ade8a814488bb141835e2ac331b',ramdisk_id='',reservation_id='r-4p2x10pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2091682056',owner_user_name='tempest-AttachVolumeTestJSON-2091682056-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:30:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15122cbfe21b4775b679285eeb4beff7',uuid=d2c4575b-ef8d-4a9d-9650-459366b7227e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converting VIF {"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG os_vif [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92bcfe63-957a-5dc6-9286-3f885375511d', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bb5ab2c-fa, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bb5ab2c-fa, col_values=(('qos', UUID('7575f4a1-6198-44a3-b82c-53734614d6da')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bb5ab2c-fa, col_values=(('external_ids', {'iface-id': '0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:52:b6', 'vm-uuid': 'd2c4575b-ef8d-4a9d-9650-459366b7227e'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:32:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:13 user nova-compute[75100]: INFO os_vif [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa')
Nov 13 17:32:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-e1ca38de-60af-4944-b8ed-bea5e965f640 req-41cb4a7e-fe50-4d08-921a-a41415154911 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e1ca38de-60af-4944-b8ed-bea5e965f640 req-41cb4a7e-fe50-4d08-921a-a41415154911 service nova] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e1ca38de-60af-4944-b8ed-bea5e965f640 req-41cb4a7e-fe50-4d08-921a-a41415154911 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e1ca38de-60af-4944-b8ed-bea5e965f640 req-41cb4a7e-fe50-4d08-921a-a41415154911 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-e1ca38de-60af-4944-b8ed-bea5e965f640 req-41cb4a7e-fe50-4d08-921a-a41415154911 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] No waiting events found dispatching network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:32:14 user nova-compute[75100]: WARNING nova.compute.manager [req-e1ca38de-60af-4944-b8ed-bea5e965f640 req-41cb4a7e-fe50-4d08-921a-a41415154911 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received unexpected event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd for instance with vm_state stopped and task_state powering-on.
Nov 13 17:32:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:32:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance rebooted successfully.
Nov 13 17:32:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-4559bdef-0b14-4b26-a729-1dd6abdfdee9 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:32:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-ff6f5f8c-10cc-4c88-ab58-5717897d3377 req-988e4427-1c51-427e-8ad8-dfce7521cb62 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff6f5f8c-10cc-4c88-ab58-5717897d3377 req-988e4427-1c51-427e-8ad8-dfce7521cb62 service nova] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff6f5f8c-10cc-4c88-ab58-5717897d3377 req-988e4427-1c51-427e-8ad8-dfce7521cb62 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff6f5f8c-10cc-4c88-ab58-5717897d3377 req-988e4427-1c51-427e-8ad8-dfce7521cb62 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-ff6f5f8c-10cc-4c88-ab58-5717897d3377 req-988e4427-1c51-427e-8ad8-dfce7521cb62 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] No waiting events found dispatching network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:32:16 user nova-compute[75100]: WARNING nova.compute.manager [req-ff6f5f8c-10cc-4c88-ab58-5717897d3377 req-988e4427-1c51-427e-8ad8-dfce7521cb62 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received unexpected event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd for instance with vm_state active and task_state None.
Nov 13 17:32:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-38ff7e10-13b9-4cc8-9fa7-fde34b4d9dcb req-1e62b92b-bfce-4a5e-b322-3efc8007a629 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-changed-06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-38ff7e10-13b9-4cc8-9fa7-fde34b4d9dcb req-1e62b92b-bfce-4a5e-b322-3efc8007a629 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Refreshing instance network info cache due to event network-changed-06242103-0705-434a-8b09-54be30f73283. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-38ff7e10-13b9-4cc8-9fa7-fde34b4d9dcb req-1e62b92b-bfce-4a5e-b322-3efc8007a629 service nova] Acquiring lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-38ff7e10-13b9-4cc8-9fa7-fde34b4d9dcb req-1e62b92b-bfce-4a5e-b322-3efc8007a629 service nova] Acquired lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-38ff7e10-13b9-4cc8-9fa7-fde34b4d9dcb req-1e62b92b-bfce-4a5e-b322-3efc8007a629 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Refreshing network info cache for port 06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-38ff7e10-13b9-4cc8-9fa7-fde34b4d9dcb req-1e62b92b-bfce-4a5e-b322-3efc8007a629 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Updated VIF entry in instance network info cache for port 06242103-0705-434a-8b09-54be30f73283. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-38ff7e10-13b9-4cc8-9fa7-fde34b4d9dcb req-1e62b92b-bfce-4a5e-b322-3efc8007a629 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Updating instance_info_cache with network_info: [{"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-38ff7e10-13b9-4cc8-9fa7-fde34b4d9dcb req-1e62b92b-bfce-4a5e-b322-3efc8007a629 service nova] Releasing lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "interface-bcb48f07-30a1-48a1-b739-49bf2513c013-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "interface-bcb48f07-30a1-48a1-b739-49bf2513c013-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lazy-loading 'flavor' on Instance uuid bcb48f07-30a1-48a1-b739-49bf2513c013 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lazy-loading 'pci_requests' on Instance uuid bcb48f07-30a1-48a1-b739-49bf2513c013 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG nova.objects.base [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Object Instance<bcb48f07-30a1-48a1-b739-49bf2513c013> lazy-loaded attributes: flavor,pci_requests {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:32:22 user nova-compute[75100]: DEBUG nova.policy [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b10372a7ca7845d8970b4f957afd249d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b8e980410348b48bf04fc382c4e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:32:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:23 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:32:23 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Successfully created port: fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Successfully updated port: fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquired lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-4b5b5b8e-5364-4a78-a288-fd02ecd1ce2a req-d77ff8b7-27f8-4061-977c-ed63d943fcb8 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-changed-fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-4b5b5b8e-5364-4a78-a288-fd02ecd1ce2a req-d77ff8b7-27f8-4061-977c-ed63d943fcb8 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Refreshing instance network info cache due to event network-changed-fea81257-dac0-4e3c-8b1e-ea23b00449a1. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4b5b5b8e-5364-4a78-a288-fd02ecd1ce2a req-d77ff8b7-27f8-4061-977c-ed63d943fcb8 service nova] Acquiring lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Updating instance_info_cache with network_info: [{"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Releasing lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4b5b5b8e-5364-4a78-a288-fd02ecd1ce2a req-d77ff8b7-27f8-4061-977c-ed63d943fcb8 service nova] Acquired lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-4b5b5b8e-5364-4a78-a288-fd02ecd1ce2a req-d77ff8b7-27f8-4061-977c-ed63d943fcb8 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Refreshing network info cache for port fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1119793217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1119793217',id=28,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvx8JQIBkL21nN5cuKYIjTT8NnZAWSZMP2QkZAc6pbLZaJgU2fYiAQEBg0Xgdwf3KsbdPq5Sf/a+dIZy7MOu0OovA6J7QJWFX9Lec9YN4YQPY7+toKNUPqHUKmWixmRqw==',key_name='tempest-keypair-1552872187',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='48b8e980410348b48bf04fc382c4e60c',ramdisk_id='',reservation_id='r-n03514yb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1699715910',owner_user_name='tempest-TaggedAttachmentsTest-1699715910-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b10372a7ca7845d8970b4f957afd249d',uuid=bcb48f07-30a1-48a1-b739-49bf2513c013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converting VIF {"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d0:54,bridge_name='br-int',has_traffic_filtering=True,id=fea81257-dac0-4e3c-8b1e-ea23b00449a1,network=Network(165302f5-40f8-42db-8278-b8c3710f0958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea81257-da') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG os_vif [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d0:54,bridge_name='br-int',has_traffic_filtering=True,id=fea81257-dac0-4e3c-8b1e-ea23b00449a1,network=Network(165302f5-40f8-42db-8278-b8c3710f0958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea81257-da') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9f3cac7-be76-5c6d-bc7e-a1607f0670bf', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfea81257-da, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfea81257-da, col_values=(('qos', UUID('4327fdd1-8e72-4229-a9bd-35d14fbcedf5')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfea81257-da, col_values=(('external_ids', {'iface-id': 'fea81257-dac0-4e3c-8b1e-ea23b00449a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:d0:54', 'vm-uuid': 'bcb48f07-30a1-48a1-b739-49bf2513c013'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:24 user nova-compute[75100]: INFO os_vif [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d0:54,bridge_name='br-int',has_traffic_filtering=True,id=fea81257-dac0-4e3c-8b1e-ea23b00449a1,network=Network(165302f5-40f8-42db-8278-b8c3710f0958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea81257-da')
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1119793217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1119793217',id=28,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvx8JQIBkL21nN5cuKYIjTT8NnZAWSZMP2QkZAc6pbLZaJgU2fYiAQEBg0Xgdwf3KsbdPq5Sf/a+dIZy7MOu0OovA6J7QJWFX9Lec9YN4YQPY7+toKNUPqHUKmWixmRqw==',key_name='tempest-keypair-1552872187',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='48b8e980410348b48bf04fc382c4e60c',ramdisk_id='',reservation_id='r-n03514yb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1699715910',owner_user_name='tempest-TaggedAttachmentsTest-1699715910-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b10372a7ca7845d8970b4f957afd249d',uuid=bcb48f07-30a1-48a1-b739-49bf2513c013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converting VIF {"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d0:54,bridge_name='br-int',has_traffic_filtering=True,id=fea81257-dac0-4e3c-8b1e-ea23b00449a1,network=Network(165302f5-40f8-42db-8278-b8c3710f0958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea81257-da') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] attach device xml: <interface type="ethernet">
Nov 13 17:32:24 user nova-compute[75100]:   <mac address="fa:16:3e:f9:d0:54"/>
Nov 13 17:32:24 user nova-compute[75100]:   <model type="virtio"/>
Nov 13 17:32:24 user nova-compute[75100]:   <mtu size="1442"/>
Nov 13 17:32:24 user nova-compute[75100]:   <target dev="tapfea81257-da"/>
Nov 13 17:32:24 user nova-compute[75100]: </interface>
Nov 13 17:32:24 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] No BDM found with device name hda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] No VIF found with MAC fa:16:3e:3b:85:9d, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:32:25 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 13 17:32:25 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1119793217</nova:name>
Nov 13 17:32:25 user nova-compute[75100]:   <nova:creationTime>2023-11-13 17:32:25</nova:creationTime>
Nov 13 17:32:25 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 13 17:32:25 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 13 17:32:25 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 13 17:32:25 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 13 17:32:25 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:32:25 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 13 17:32:25 user nova-compute[75100]:   </nova:flavor>
Nov 13 17:32:25 user nova-compute[75100]:   <nova:owner>
Nov 13 17:32:25 user nova-compute[75100]:     <nova:user uuid="b10372a7ca7845d8970b4f957afd249d">tempest-TaggedAttachmentsTest-1699715910-project-member</nova:user>
Nov 13 17:32:25 user nova-compute[75100]:     <nova:project uuid="48b8e980410348b48bf04fc382c4e60c">tempest-TaggedAttachmentsTest-1699715910</nova:project>
Nov 13 17:32:25 user nova-compute[75100]:   </nova:owner>
Nov 13 17:32:25 user nova-compute[75100]:   <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:32:25 user nova-compute[75100]:   <nova:ports>
Nov 13 17:32:25 user nova-compute[75100]:     <nova:port uuid="06242103-0705-434a-8b09-54be30f73283">
Nov 13 17:32:25 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 17:32:25 user nova-compute[75100]:     </nova:port>
Nov 13 17:32:25 user nova-compute[75100]:     <nova:port uuid="fea81257-dac0-4e3c-8b1e-ea23b00449a1">
Nov 13 17:32:25 user nova-compute[75100]:       <nova:ip type="fixed" address="10.10.10.93" ipVersion="4"/>
Nov 13 17:32:25 user nova-compute[75100]:     </nova:port>
Nov 13 17:32:25 user nova-compute[75100]:   </nova:ports>
Nov 13 17:32:25 user nova-compute[75100]: </nova:instance>
Nov 13 17:32:25 user nova-compute[75100]:  {{(pid=75100) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-4b5b5b8e-5364-4a78-a288-fd02ecd1ce2a req-d77ff8b7-27f8-4061-977c-ed63d943fcb8 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Updated VIF entry in instance network info cache for port fea81257-dac0-4e3c-8b1e-ea23b00449a1. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-4b5b5b8e-5364-4a78-a288-fd02ecd1ce2a req-d77ff8b7-27f8-4061-977c-ed63d943fcb8 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Updating instance_info_cache with network_info: [{"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5ae668e0-9129-49ea-a5fb-f92176903ff1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "interface-bcb48f07-30a1-48a1-b739-49bf2513c013-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.502s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4b5b5b8e-5364-4a78-a288-fd02ecd1ce2a req-d77ff8b7-27f8-4061-977c-ed63d943fcb8 service nova] Releasing lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG nova.objects.instance [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lazy-loading 'flavor' on Instance uuid bcb48f07-30a1-48a1-b739-49bf2513c013 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:25 user nova-compute[75100]: INFO nova.compute.manager [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Attaching volume 00cf0697-35e4-41a1-9383-a15f3bc5ad88 to /dev/vdb
Nov 13 17:32:25 user nova-compute[75100]: DEBUG os_brick.utils [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed25f07-78f4-47ec-b571-e3215a3240bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bb9975-d0c8-48c3-9441-790c36980e8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec11e7b2-254c-463a-9682-ca79a33f1992]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b96fb38-0ccf-4e8e-bf95-cbbba9f0ef9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:32:25 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:32:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8513b42e-2c16-489a-a9c0-1faf13a29c02]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG os_brick.utils [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:32:25 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Updating existing volume attachment record: 70fd03c4-08af-4c65-b9de-f18f3cfbfbb5 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-df005a57-a994-4702-aeb2-ffd7dcfca983 req-910e3f16-6f58-4724-a5bc-6796e03805be service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-vif-plugged-fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df005a57-a994-4702-aeb2-ffd7dcfca983 req-910e3f16-6f58-4724-a5bc-6796e03805be service nova] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df005a57-a994-4702-aeb2-ffd7dcfca983 req-910e3f16-6f58-4724-a5bc-6796e03805be service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df005a57-a994-4702-aeb2-ffd7dcfca983 req-910e3f16-6f58-4724-a5bc-6796e03805be service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-df005a57-a994-4702-aeb2-ffd7dcfca983 req-910e3f16-6f58-4724-a5bc-6796e03805be service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] No waiting events found dispatching network-vif-plugged-fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:32:26 user nova-compute[75100]: WARNING nova.compute.manager [req-df005a57-a994-4702-aeb2-ffd7dcfca983 req-910e3f16-6f58-4724-a5bc-6796e03805be service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received unexpected event network-vif-plugged-fea81257-dac0-4e3c-8b1e-ea23b00449a1 for instance with vm_state active and task_state None.
Nov 13 17:32:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-df005a57-a994-4702-aeb2-ffd7dcfca983 req-910e3f16-6f58-4724-a5bc-6796e03805be service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-vif-plugged-fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df005a57-a994-4702-aeb2-ffd7dcfca983 req-910e3f16-6f58-4724-a5bc-6796e03805be service nova] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df005a57-a994-4702-aeb2-ffd7dcfca983 req-910e3f16-6f58-4724-a5bc-6796e03805be service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df005a57-a994-4702-aeb2-ffd7dcfca983 req-910e3f16-6f58-4724-a5bc-6796e03805be service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-df005a57-a994-4702-aeb2-ffd7dcfca983 req-910e3f16-6f58-4724-a5bc-6796e03805be service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] No waiting events found dispatching network-vif-plugged-fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:32:26 user nova-compute[75100]: WARNING nova.compute.manager [req-df005a57-a994-4702-aeb2-ffd7dcfca983 req-910e3f16-6f58-4724-a5bc-6796e03805be service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received unexpected event network-vif-plugged-fea81257-dac0-4e3c-8b1e-ea23b00449a1 for instance with vm_state active and task_state None.
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:32:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:32:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhDZTkoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:32:30 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:32:30 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:32:30 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c719a4cc-41c4-4b5a-80d6-d983f58e81b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:32:30 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd89f9e-5c75-4a3b-bc4c-b25fb626270a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88] added
Nov 13 17:32:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[287c4f7d-2868-47ac-b618-f9e2650e67a7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6346dd8b-1e16-466c-933b-945d099421ba]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qhDZTkoz {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qhDZTkoz" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[52266ac3-0137-4ea2-b676-5a69bb35610a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qhDZTkoz'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[527ad763-6e16-4e06-b482-3301b252ccc8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[465e16b4-530f-4704-baa5-57b0929fc0a6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2ec6ae-bd4a-4c3c-9451-07b290789403]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88, portal: 172.16.0.220,3260]
Nov 13 17:32:30 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88, portal: 172.16.0.220,3260] successful.
Nov 13 17:32:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[94571717-4a82-486e-b471-e68a7f43579f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c70893d-21d6-4c21-a030-e9dd7859dd1b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:30 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)
Nov 13 17:32:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef96a7d-3ce4-4efc-9f80-b49a7baf8c4c]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:31 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:32:31 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7049MB free_disk=25.004261016845703GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d2c4575b-ef8d-4a9d-9650-459366b7227e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d30816f4-82ec-43b9-bd47-f34190e5c82f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance bcb48f07-30a1-48a1-b739-49bf2513c013 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 73c5d863-7cae-481f-b8ea-dfc217514658 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance a5f308a2-3b44-476e-85ab-15e1bf107968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhDZTkoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '26562613039656438', 'path': '/dev/sdg'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562613039656438', 'path': '/dev/sdg'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lazy-loading 'flavor' on Instance uuid bcb48f07-30a1-48a1-b739-49bf2513c013 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:32:31 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:32:31 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:32:31 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:32:31 user nova-compute[75100]:   <serial>00cf0697-35e4-41a1-9383-a15f3bc5ad88</serial>
Nov 13 17:32:31 user nova-compute[75100]: </disk>
Nov 13 17:32:31 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:32:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:32:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] No BDM found with device name hda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:32:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] No VIF found with MAC fa:16:3e:3b:85:9d, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:32:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-73228964-c219-4bec-a6cc-ed0dea47dcd4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.465s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:32:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:32:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:32:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:32:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:32:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Updating instance_info_cache with network_info: [{"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:32:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-d2c4575b-ef8d-4a9d-9650-459366b7227e" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:32:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:32:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:32:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:32:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:32:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:32:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:33 user nova-compute[75100]: INFO nova.compute.manager [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Detaching volume 00cf0697-35e4-41a1-9383-a15f3bc5ad88
Nov 13 17:32:34 user nova-compute[75100]: INFO nova.virt.block_device [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Attempting to driver detach volume 00cf0697-35e4-41a1-9383-a15f3bc5ad88 from mountpoint /dev/vdb
Nov 13 17:32:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Attempting to detach device vdb from instance bcb48f07-30a1-48a1-b739-49bf2513c013 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:32:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:32:34 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:32:34 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:32:34 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:32:34 user nova-compute[75100]:   <serial>00cf0697-35e4-41a1-9383-a15f3bc5ad88</serial>
Nov 13 17:32:34 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 17:32:34 user nova-compute[75100]: </disk>
Nov 13 17:32:34 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:32:34 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Successfully detached device vdb from instance bcb48f07-30a1-48a1-b739-49bf2513c013 from the persistent domain config.
Nov 13 17:32:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bcb48f07-30a1-48a1-b739-49bf2513c013 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:32:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:32:34 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:32:34 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:32:34 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:32:34 user nova-compute[75100]:   <serial>00cf0697-35e4-41a1-9383-a15f3bc5ad88</serial>
Nov 13 17:32:34 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 17:32:34 user nova-compute[75100]: </disk>
Nov 13 17:32:34 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:32:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bcb48f07-30a1-48a1-b739-49bf2513c013 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:32:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:32:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-ded17336-a766-4aaf-a9bc-88327b88dd32 req-eda792cc-41c9-4603-a8a2-546e1d6fbd46 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Received event network-changed-15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-ded17336-a766-4aaf-a9bc-88327b88dd32 req-eda792cc-41c9-4603-a8a2-546e1d6fbd46 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Refreshing instance network info cache due to event network-changed-15335f7b-d811-486f-a5ce-3643fa79fbc7. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:32:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ded17336-a766-4aaf-a9bc-88327b88dd32 req-eda792cc-41c9-4603-a8a2-546e1d6fbd46 service nova] Acquiring lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:32:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ded17336-a766-4aaf-a9bc-88327b88dd32 req-eda792cc-41c9-4603-a8a2-546e1d6fbd46 service nova] Acquired lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:32:42 user nova-compute[75100]: DEBUG nova.network.neutron [req-ded17336-a766-4aaf-a9bc-88327b88dd32 req-eda792cc-41c9-4603-a8a2-546e1d6fbd46 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Refreshing network info cache for port 15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:32:43 user nova-compute[75100]: DEBUG nova.network.neutron [req-ded17336-a766-4aaf-a9bc-88327b88dd32 req-eda792cc-41c9-4603-a8a2-546e1d6fbd46 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updated VIF entry in instance network info cache for port 15335f7b-d811-486f-a5ce-3643fa79fbc7. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:32:43 user nova-compute[75100]: DEBUG nova.network.neutron [req-ded17336-a766-4aaf-a9bc-88327b88dd32 req-eda792cc-41c9-4603-a8a2-546e1d6fbd46 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updating instance_info_cache with network_info: [{"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:32:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ded17336-a766-4aaf-a9bc-88327b88dd32 req-eda792cc-41c9-4603-a8a2-546e1d6fbd46 service nova] Releasing lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:32:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Stashing vm_state: active {{(pid=75100) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 13 17:32:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:32:44 user nova-compute[75100]: INFO nova.compute.claims [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Claim successful on node user
Nov 13 17:32:44 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Updating resource usage from migration 35421aba-e45e-42f4-a2a1-b50a2e57287f
Nov 13 17:32:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-1a3a4584-d16e-4158-86a5-4f41b7a9669a req-ba869abf-ad7c-43db-b6fd-1519d362b2e2 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received event network-changed-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-1a3a4584-d16e-4158-86a5-4f41b7a9669a req-ba869abf-ad7c-43db-b6fd-1519d362b2e2 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Refreshing instance network info cache due to event network-changed-abbcd619-e7dc-4dd0-b1a4-4c542462c321. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:32:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1a3a4584-d16e-4158-86a5-4f41b7a9669a req-ba869abf-ad7c-43db-b6fd-1519d362b2e2 service nova] Acquiring lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:32:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1a3a4584-d16e-4158-86a5-4f41b7a9669a req-ba869abf-ad7c-43db-b6fd-1519d362b2e2 service nova] Acquired lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:32:44 user nova-compute[75100]: DEBUG nova.network.neutron [req-1a3a4584-d16e-4158-86a5-4f41b7a9669a req-ba869abf-ad7c-43db-b6fd-1519d362b2e2 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Refreshing network info cache for port abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.499s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:45 user nova-compute[75100]: INFO nova.compute.manager [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Migrating
Nov 13 17:32:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG nova.network.neutron [req-1a3a4584-d16e-4158-86a5-4f41b7a9669a req-ba869abf-ad7c-43db-b6fd-1519d362b2e2 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Updated VIF entry in instance network info cache for port abbcd619-e7dc-4dd0-b1a4-4c542462c321. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG nova.network.neutron [req-1a3a4584-d16e-4158-86a5-4f41b7a9669a req-ba869abf-ad7c-43db-b6fd-1519d362b2e2 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Updating instance_info_cache with network_info: [{"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1a3a4584-d16e-4158-86a5-4f41b7a9669a req-ba869abf-ad7c-43db-b6fd-1519d362b2e2 service nova] Releasing lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquired lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Updating instance_info_cache with network_info: [{"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Releasing lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Starting migrate_disk_and_power_off {{(pid=75100) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-b232daaa-2a2c-44b7-be2b-74f146d35c9e req-3a8f940f-c99e-4705-9f25-ac02dcbd772c service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received event network-vif-unplugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b232daaa-2a2c-44b7-be2b-74f146d35c9e req-3a8f940f-c99e-4705-9f25-ac02dcbd772c service nova] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b232daaa-2a2c-44b7-be2b-74f146d35c9e req-3a8f940f-c99e-4705-9f25-ac02dcbd772c service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b232daaa-2a2c-44b7-be2b-74f146d35c9e req-3a8f940f-c99e-4705-9f25-ac02dcbd772c service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-b232daaa-2a2c-44b7-be2b-74f146d35c9e req-3a8f940f-c99e-4705-9f25-ac02dcbd772c service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] No waiting events found dispatching network-vif-unplugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:32:46 user nova-compute[75100]: WARNING nova.compute.manager [req-b232daaa-2a2c-44b7-be2b-74f146d35c9e req-3a8f940f-c99e-4705-9f25-ac02dcbd772c service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received unexpected event network-vif-unplugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 for instance with vm_state active and task_state resize_migrating.
Nov 13 17:32:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:46 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Instance destroyed successfully.
Nov 13 17:32:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-95005404',display_name='tempest-ServerActionsTestOtherA-server-95005404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-95005404',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArXX8H/F/4k/bCD26MQyJfYc6kVyijAa21ATX3s9SJ4y/SgOLDqvjWXABytQ7Y0rezN8922Yqg0PmzPzy90j9+erJSCwuQJnigd+guQkVWmuyFrLUQ16eK1oB+ijXr+Rw==',key_name='tempest-keypair-216019137',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-g1hxuk35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:32:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=73c5d863-7cae-481f-b8ea-dfc217514658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507746899-network", "vif_mac": "fa:16:3e:e9:c5:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507746899-network", "vif_mac": "fa:16:3e:e9:c5:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_vif [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabbcd619-e7, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9c809dc-2b72-482a-aace-d5be1018ecd5) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:46 user nova-compute[75100]: INFO os_vif [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7')
Nov 13 17:32:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZlmQkVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:32:46 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca39eed7-c3ce-49de-a9f3-4dbf44ce6a97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:32:46 user nova-compute[75100]: No targets found.
Nov 13 17:32:46 user nova-compute[75100]: iSNS:
Nov 13 17:32:46 user nova-compute[75100]: No targets found.
Nov 13 17:32:46 user nova-compute[75100]: STATIC:
Nov 13 17:32:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:32:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:32:46 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:32:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88
Nov 13 17:32:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:32:46 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:32:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22
Nov 13 17:32:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:32:46 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:32:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7
Nov 13 17:32:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:32:46 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:32:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:32:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:32:46 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:32:46 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:32:46 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:32:46 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:32:46 user nova-compute[75100]: FIRMWARE:
Nov 13 17:32:46 user nova-compute[75100]: No targets found.
Nov 13 17:32:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:32:46 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:32:46 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[441d7eaa-a94f-4c74-8d57-e6c2c3d7bfea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bd79ff-b12d-49db-88ab-5945e35ee301]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:46 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:46 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:46 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:46 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:46 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)
Nov 13 17:32:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:46 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:46 user nova-compute[75100]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:46 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:46 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:46 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)
Nov 13 17:32:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38c3c160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[935563e8-41f3-4559-83b5-04e73f0f0dea]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfd552a-4d84-44ec-9d25-4d1d44e9b728]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7275788c-8aed-4ba8-ba4b-b57345fbaddf]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d399ab92-6667-478d-a20c-82018345269c]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23632643032313730', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_629bfe15', '/dev/disk/by-id/scsi-1SCST_BIO629bfe15-62d02170801a4645') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 17:32:46 user nova-compute[75100]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23632643032313730
Nov 13 17:32:46 user nova-compute[75100]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_629bfe15
Nov 13 17:32:46 user nova-compute[75100]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO629bfe15-62d02170801a4645
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[75089d1b-199c-4351-a59a-7e78c083718e]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d077fb7-53d5-4aac-a48a-d476634fe45b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25ee7ba-5576-48f2-b15f-b4a40aa08376]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260]
Nov 13 17:32:46 user nova-compute[75100]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260] successful.
Nov 13 17:32:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d1b1ee-88a3-423c-a9f9-3cbb8a7df694]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== disconnect_volume: return (345ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:32:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:32:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:47 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Port abbcd619-e7dc-4dd0-b1a4-4c542462c321 binding to destination host user is already ACTIVE {{(pid=75100) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquired lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-2d1ced01-a57f-444e-871f-aef1f56967b1 req-2a7d978a-a087-4be3-a0cc-bef30737eb38 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received event network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2d1ced01-a57f-444e-871f-aef1f56967b1 req-2a7d978a-a087-4be3-a0cc-bef30737eb38 service nova] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2d1ced01-a57f-444e-871f-aef1f56967b1 req-2a7d978a-a087-4be3-a0cc-bef30737eb38 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2d1ced01-a57f-444e-871f-aef1f56967b1 req-2a7d978a-a087-4be3-a0cc-bef30737eb38 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-2d1ced01-a57f-444e-871f-aef1f56967b1 req-2a7d978a-a087-4be3-a0cc-bef30737eb38 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] No waiting events found dispatching network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:32:48 user nova-compute[75100]: WARNING nova.compute.manager [req-2d1ced01-a57f-444e-871f-aef1f56967b1 req-2a7d978a-a087-4be3-a0cc-bef30737eb38 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received unexpected event network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 for instance with vm_state active and task_state resize_migrated.
Nov 13 17:32:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Updating instance_info_cache with network_info: [{"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Releasing lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG os_brick.utils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[342b740a-0365-4d37-a6a0-8dc980504f3e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55ba614-df75-41d0-8dd0-efc29b93ce71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf98c21-c9d1-47b1-aab6-9d6c78380c55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f562ddac-f597-4251-8c83-3b1f94c1451d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:32:48 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:32:48 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05a5335-80a2-4c76-ab32-66af956f390e]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:32:48 user nova-compute[75100]: DEBUG os_brick.utils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:32:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Starting finish_migration {{(pid=75100) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 17:32:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Creating image(s)
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Ensure instance console log exists: /opt/stack/data/nova/instances/73c5d863-7cae-481f-b8ea-dfc217514658/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Start _get_guest_xml network_info=[{"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507746899-network", "vif_mac": "fa:16:3e:e9:c5:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'e44637cb-4416-4fa6-a30a-9bca87edc0ad', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZlmQkVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '73c5d863-7cae-481f-b8ea-dfc217514658', 'attached_at': '2023-11-13T17:32:53.000000', 'detached_at': '', 'volume_id': 'b6f577ba-2aaa-4622-8530-3e5461d39c23', 'serial': 'b6f577ba-2aaa-4622-8530-3e5461d39c23'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:32:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:32:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:30Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZlmQkVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:32:53 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:32:53 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:32:53 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[437a42b8-1e53-4c56-9bb0-1f6abecaf39d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:32:53 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd6cbf0-4e3f-4b28-9f1b-e46ad38874bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23] added
Nov 13 17:32:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bdb117-d09c-48da-99bb-5dea7b3f2049]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f97cedd-0938-4d64-8efc-9ce443a4f92c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZlmQkVS {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CZlmQkVS" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c631ce-7952-4a2b-8956-4e087d594bde]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CZlmQkVS'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c42d0d6-3ebd-4ed7-9ed8-3734a9a8f2bc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb1f648-9979-4f0b-ac96-62d00a82e188]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb95692a-a8a5-4516-a0d8-c46437536a24]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260]
Nov 13 17:32:53 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260] successful.
Nov 13 17:32:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1531ca64-6fc2-450f-90e7-fe79ace622a3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[877eb847-ef4d-4fed-80eb-be21adc1ef3f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6d05f7-60d0-4880-bc9b-0f3c9060feac]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:32:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZlmQkVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lazy-loading 'flavor' on Instance uuid 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:54 user nova-compute[75100]: INFO nova.compute.manager [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Attaching volume 58db2acc-e6cc-45d7-990d-8eb67b54f4da to /dev/vdb
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.utils [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23632643032313730', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632643032313730', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[acffcd0d-8f38-4bdd-bf8a-1088267aa03d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bcb48f07-30a1-48a1-b739-49bf2513c013 is timed out.
Nov 13 17:32:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Successfully detached device vdb from instance bcb48f07-30a1-48a1-b739-49bf2513c013 from the live domain config.
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qhDZTkoz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:32:54 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-95005404',display_name='tempest-ServerActionsTestOtherA-server-95005404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-95005404',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArXX8H/F/4k/bCD26MQyJfYc6kVyijAa21ATX3s9SJ4y/SgOLDqvjWXABytQ7Y0rezN8922Yqg0PmzPzy90j9+erJSCwuQJnigd+guQkVWmuyFrLUQ16eK1oB+ijXr+Rw==',key_name='tempest-keypair-216019137',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-g1hxuk35',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:32:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=73c5d863-7cae-481f-b8ea-dfc217514658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507746899-network", "vif_mac": "fa:16:3e:e9:c5:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507746899-network", "vif_mac": "fa:16:3e:e9:c5:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:32:54 user nova-compute[75100]:   <uuid>73c5d863-7cae-481f-b8ea-dfc217514658</uuid>
Nov 13 17:32:54 user nova-compute[75100]:   <name>instance-0000001d</name>
Nov 13 17:32:54 user nova-compute[75100]:   <memory>2097152</memory>
Nov 13 17:32:54 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:32:54 user nova-compute[75100]:   <metadata>
Nov 13 17:32:54 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:32:54 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:32:54 user nova-compute[75100]:       <nova:name>tempest-ServerActionsTestOtherA-server-95005404</nova:name>
Nov 13 17:32:54 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:32:53</nova:creationTime>
Nov 13 17:32:54 user nova-compute[75100]:       <nova:flavor name="m1.small">
Nov 13 17:32:54 user nova-compute[75100]:         <nova:memory>2048</nova:memory>
Nov 13 17:32:54 user nova-compute[75100]:         <nova:disk>20</nova:disk>
Nov 13 17:32:54 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:32:54 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:32:54 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:32:54 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:32:54 user nova-compute[75100]:       <nova:owner>
Nov 13 17:32:54 user nova-compute[75100]:         <nova:user uuid="7ea28cc48696459f96e7ad8dacad33da">tempest-ServerActionsTestOtherA-226710821-project-member</nova:user>
Nov 13 17:32:54 user nova-compute[75100]:         <nova:project uuid="119dde6420324f52a165a5610c77d1c3">tempest-ServerActionsTestOtherA-226710821</nova:project>
Nov 13 17:32:54 user nova-compute[75100]:       </nova:owner>
Nov 13 17:32:54 user nova-compute[75100]:       <nova:ports>
Nov 13 17:32:54 user nova-compute[75100]:         <nova:port uuid="abbcd619-e7dc-4dd0-b1a4-4c542462c321">
Nov 13 17:32:54 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 17:32:54 user nova-compute[75100]:         </nova:port>
Nov 13 17:32:54 user nova-compute[75100]:       </nova:ports>
Nov 13 17:32:54 user nova-compute[75100]:     </nova:instance>
Nov 13 17:32:54 user nova-compute[75100]:   </metadata>
Nov 13 17:32:54 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:32:54 user nova-compute[75100]:     <system>
Nov 13 17:32:54 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:32:54 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:32:54 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:32:54 user nova-compute[75100]:       <entry name="serial">73c5d863-7cae-481f-b8ea-dfc217514658</entry>
Nov 13 17:32:54 user nova-compute[75100]:       <entry name="uuid">73c5d863-7cae-481f-b8ea-dfc217514658</entry>
Nov 13 17:32:54 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:32:54 user nova-compute[75100]:     </system>
Nov 13 17:32:54 user nova-compute[75100]:   </sysinfo>
Nov 13 17:32:54 user nova-compute[75100]:   <os>
Nov 13 17:32:54 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:32:54 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:32:54 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:32:54 user nova-compute[75100]:   </os>
Nov 13 17:32:54 user nova-compute[75100]:   <features>
Nov 13 17:32:54 user nova-compute[75100]:     <acpi/>
Nov 13 17:32:54 user nova-compute[75100]:     <apic/>
Nov 13 17:32:54 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:32:54 user nova-compute[75100]:   </features>
Nov 13 17:32:54 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:32:54 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:32:54 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:32:54 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:32:54 user nova-compute[75100]:   </clock>
Nov 13 17:32:54 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:32:54 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:32:54 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:32:54 user nova-compute[75100]:   </cpu>
Nov 13 17:32:54 user nova-compute[75100]:   <devices>
Nov 13 17:32:54 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:32:54 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:32:54 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 13 17:32:54 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:32:54 user nova-compute[75100]:       <serial>b6f577ba-2aaa-4622-8530-3e5461d39c23</serial>
Nov 13 17:32:54 user nova-compute[75100]:     </disk>
Nov 13 17:32:54 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:32:54 user nova-compute[75100]:       <mac address="fa:16:3e:e9:c5:34"/>
Nov 13 17:32:54 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:32:54 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:32:54 user nova-compute[75100]:       <target dev="tapabbcd619-e7"/>
Nov 13 17:32:54 user nova-compute[75100]:     </interface>
Nov 13 17:32:54 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:32:54 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/73c5d863-7cae-481f-b8ea-dfc217514658/console.log" append="off"/>
Nov 13 17:32:54 user nova-compute[75100]:     </serial>
Nov 13 17:32:54 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:32:54 user nova-compute[75100]:     <video>
Nov 13 17:32:54 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:32:54 user nova-compute[75100]:     </video>
Nov 13 17:32:54 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:32:54 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:32:54 user nova-compute[75100]:     </rng>
Nov 13 17:32:54 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:32:54 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:32:54 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:32:54 user nova-compute[75100]:     </memballoon>
Nov 13 17:32:54 user nova-compute[75100]:   </devices>
Nov 13 17:32:54 user nova-compute[75100]: </domain>
Nov 13 17:32:54 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-95005404',display_name='tempest-ServerActionsTestOtherA-server-95005404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-95005404',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArXX8H/F/4k/bCD26MQyJfYc6kVyijAa21ATX3s9SJ4y/SgOLDqvjWXABytQ7Y0rezN8922Yqg0PmzPzy90j9+erJSCwuQJnigd+guQkVWmuyFrLUQ16eK1oB+ijXr+Rw==',key_name='tempest-keypair-216019137',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-g1hxuk35',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:32:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=73c5d863-7cae-481f-b8ea-dfc217514658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507746899-network", "vif_mac": "fa:16:3e:e9:c5:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507746899-network", "vif_mac": "fa:16:3e:e9:c5:34"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_vif [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6f9af1-a690-44c2-acb4-960537835db9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95c73e75-70fd-5399-afc6-e58b7a602b58', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabbcd619-e7, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabbcd619-e7, col_values=(('qos', UUID('56257d8f-aef0-4417-879e-b236d3d438f8')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabbcd619-e7, col_values=(('external_ids', {'iface-id': 'abbcd619-e7dc-4dd0-b1a4-4c542462c321', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:c5:34', 'vm-uuid': '73c5d863-7cae-481f-b8ea-dfc217514658'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1279b7-de30-4318-a04d-843ac139b61e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:32:54 user nova-compute[75100]: No targets found.
Nov 13 17:32:54 user nova-compute[75100]: iSNS:
Nov 13 17:32:54 user nova-compute[75100]: No targets found.
Nov 13 17:32:54 user nova-compute[75100]: STATIC:
Nov 13 17:32:54 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:32:54 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:32:54 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:32:54 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88
Nov 13 17:32:54 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:32:54 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:32:54 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22
Nov 13 17:32:54 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:32:54 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:32:54 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7
Nov 13 17:32:54 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:32:54 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:32:54 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:32:54 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:32:54 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:32:54 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:32:54 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:32:54 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:32:54 user nova-compute[75100]: FIRMWARE:
Nov 13 17:32:54 user nova-compute[75100]: No targets found.
Nov 13 17:32:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:32:54 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:32:54 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:54 user nova-compute[75100]: INFO os_vif [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7')
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e045fc-59a5-47b9-8e5e-48909e5f4918]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3f93ad-6e27-4df4-a224-3f9208a91bcc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[08979470-2c55-43c3-a172-2ad883d05efe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:32:54 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfdfcbe-9448-4e6d-bc4c-ae5a7871e004]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.utils [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updating existing volume attachment record: c3051ef0-fff3-41e1-8fde-5f5d89acfe4f {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcf79fb-f1d9-46f2-b5bb-ada8662d00a5]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:54 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:54 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:54 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:54 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)
Nov 13 17:32:54 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:54 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:54 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:54 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:54 user nova-compute[75100]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 (non-flash)
Nov 13 17:32:54 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38d43be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88'): ({'sdg'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Removing single pathed devices sdg {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] No VIF found with MAC fa:16:3e:e9:c5:34, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b327fec1-4f3d-4998-9cd2-aecbd6fb9d03]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4377fc-89da-4af8-a27f-84ca65cdc6f2]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Flushing IO for device /dev/sdg {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef408f65-7d58-41a3-b073-0ae2b92e6634]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e289a91-9947-493d-ace6-9cb9f3c23f60]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b784e0-4895-4729-b6be-dcd5b5af1325]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[320e945a-1378-4b31-80aa-7a797c45f453]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88, portal: 172.16.0.220,3260]
Nov 13 17:32:54 user nova-compute[75100]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88, portal: 172.16.0.220,3260] successful.
Nov 13 17:32:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cf0697-35e4-41a1-9383-a15f3bc5ad88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd689e0-a85d-4267-89f9-80953526bba2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] <== disconnect_volume: return (376ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:32:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:32:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lazy-loading 'flavor' on Instance uuid bcb48f07-30a1-48a1-b739-49bf2513c013 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f80bb0dc-731f-43f3-bea4-900662c797d1 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.776s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf64dcde-6200-4958-8113-cd46f6459477 req-fdd11bbb-2a4e-49a2-a1df-f0b5aa4eb067 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received event network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf64dcde-6200-4958-8113-cd46f6459477 req-fdd11bbb-2a4e-49a2-a1df-f0b5aa4eb067 service nova] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf64dcde-6200-4958-8113-cd46f6459477 req-fdd11bbb-2a4e-49a2-a1df-f0b5aa4eb067 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf64dcde-6200-4958-8113-cd46f6459477 req-fdd11bbb-2a4e-49a2-a1df-f0b5aa4eb067 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf64dcde-6200-4958-8113-cd46f6459477 req-fdd11bbb-2a4e-49a2-a1df-f0b5aa4eb067 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] No waiting events found dispatching network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:32:56 user nova-compute[75100]: WARNING nova.compute.manager [req-cf64dcde-6200-4958-8113-cd46f6459477 req-fdd11bbb-2a4e-49a2-a1df-f0b5aa4eb067 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received unexpected event network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 for instance with vm_state active and task_state resize_finish.
Nov 13 17:32:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "interface-bcb48f07-30a1-48a1-b739-49bf2513c013-fea81257-dac0-4e3c-8b1e-ea23b00449a1" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "interface-bcb48f07-30a1-48a1-b739-49bf2513c013-fea81257-dac0-4e3c-8b1e-ea23b00449a1" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lazy-loading 'flavor' on Instance uuid bcb48f07-30a1-48a1-b739-49bf2513c013 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1119793217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1119793217',id=28,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvx8JQIBkL21nN5cuKYIjTT8NnZAWSZMP2QkZAc6pbLZaJgU2fYiAQEBg0Xgdwf3KsbdPq5Sf/a+dIZy7MOu0OovA6J7QJWFX9Lec9YN4YQPY7+toKNUPqHUKmWixmRqw==',key_name='tempest-keypair-1552872187',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48b8e980410348b48bf04fc382c4e60c',ramdisk_id='',reservation_id='r-n03514yb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1699715910',owner_user_name='tempest-TaggedAttachmentsTest-1699715910-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b10372a7ca7845d8970b4f957afd249d',uuid=bcb48f07-30a1-48a1-b739-49bf2513c013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converting VIF {"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d0:54,bridge_name='br-int',has_traffic_filtering=True,id=fea81257-dac0-4e3c-8b1e-ea23b00449a1,network=Network(165302f5-40f8-42db-8278-b8c3710f0958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea81257-da') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f9:d0:54"/><model type="virtio"/><mtu size="1442"/><target dev="tapfea81257-da"/></interface> {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f9:d0:54"/><model type="virtio"/><mtu size="1442"/><target dev="tapfea81257-da"/></interface> {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Attempting to detach device tapfea81257-da from instance bcb48f07-30a1-48a1-b739-49bf2513c013 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] detach device xml: <interface type="ethernet">
Nov 13 17:32:56 user nova-compute[75100]:   <mac address="fa:16:3e:f9:d0:54"/>
Nov 13 17:32:56 user nova-compute[75100]:   <model type="virtio"/>
Nov 13 17:32:56 user nova-compute[75100]:   <mtu size="1442"/>
Nov 13 17:32:56 user nova-compute[75100]:   <target dev="tapfea81257-da"/>
Nov 13 17:32:56 user nova-compute[75100]: </interface>
Nov 13 17:32:56 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f9:d0:54"/><model type="virtio"/><mtu size="1442"/><target dev="tapfea81257-da"/></interface> {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f9:d0:54"/><model type="virtio"/><mtu size="1442"/><target dev="tapfea81257-da"/></interface>not found in domain: <domain type='kvm' id='39'>
Nov 13 17:32:56 user nova-compute[75100]:   <name>instance-0000001c</name>
Nov 13 17:32:56 user nova-compute[75100]:   <uuid>bcb48f07-30a1-48a1-b739-49bf2513c013</uuid>
Nov 13 17:32:56 user nova-compute[75100]:   <metadata>
Nov 13 17:32:56 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:32:56 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 13 17:32:56 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1119793217</nova:name>
Nov 13 17:32:56 user nova-compute[75100]:   <nova:creationTime>2023-11-13 17:32:25</nova:creationTime>
Nov 13 17:32:56 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 13 17:32:56 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 13 17:32:56 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 13 17:32:56 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 13 17:32:56 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:32:56 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 13 17:32:56 user nova-compute[75100]:   </nova:flavor>
Nov 13 17:32:56 user nova-compute[75100]:   <nova:owner>
Nov 13 17:32:56 user nova-compute[75100]:     <nova:user uuid="b10372a7ca7845d8970b4f957afd249d">tempest-TaggedAttachmentsTest-1699715910-project-member</nova:user>
Nov 13 17:32:56 user nova-compute[75100]:     <nova:project uuid="48b8e980410348b48bf04fc382c4e60c">tempest-TaggedAttachmentsTest-1699715910</nova:project>
Nov 13 17:32:56 user nova-compute[75100]:   </nova:owner>
Nov 13 17:32:56 user nova-compute[75100]:   <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:32:56 user nova-compute[75100]:   <nova:ports>
Nov 13 17:32:56 user nova-compute[75100]:     <nova:port uuid="06242103-0705-434a-8b09-54be30f73283">
Nov 13 17:32:56 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 17:32:56 user nova-compute[75100]:     </nova:port>
Nov 13 17:32:56 user nova-compute[75100]:     <nova:port uuid="fea81257-dac0-4e3c-8b1e-ea23b00449a1">
Nov 13 17:32:56 user nova-compute[75100]:       <nova:ip type="fixed" address="10.10.10.93" ipVersion="4"/>
Nov 13 17:32:56 user nova-compute[75100]:     </nova:port>
Nov 13 17:32:56 user nova-compute[75100]:   </nova:ports>
Nov 13 17:32:56 user nova-compute[75100]: </nova:instance>
Nov 13 17:32:56 user nova-compute[75100]:   </metadata>
Nov 13 17:32:56 user nova-compute[75100]:   <memory unit='KiB'>524288</memory>
Nov 13 17:32:56 user nova-compute[75100]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 17:32:56 user nova-compute[75100]:   <vcpu placement='static'>1</vcpu>
Nov 13 17:32:56 user nova-compute[75100]:   <resource>
Nov 13 17:32:56 user nova-compute[75100]:     <partition>/machine</partition>
Nov 13 17:32:56 user nova-compute[75100]:   </resource>
Nov 13 17:32:56 user nova-compute[75100]:   <sysinfo type='smbios'>
Nov 13 17:32:56 user nova-compute[75100]:     <system>
Nov 13 17:32:56 user nova-compute[75100]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 17:32:56 user nova-compute[75100]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 17:32:56 user nova-compute[75100]:       <entry name='version'>0.0.0</entry>
Nov 13 17:32:56 user nova-compute[75100]:       <entry name='serial'>bcb48f07-30a1-48a1-b739-49bf2513c013</entry>
Nov 13 17:32:56 user nova-compute[75100]:       <entry name='uuid'>bcb48f07-30a1-48a1-b739-49bf2513c013</entry>
Nov 13 17:32:56 user nova-compute[75100]:       <entry name='family'>Virtual Machine</entry>
Nov 13 17:32:56 user nova-compute[75100]:     </system>
Nov 13 17:32:56 user nova-compute[75100]:   </sysinfo>
Nov 13 17:32:56 user nova-compute[75100]:   <os>
Nov 13 17:32:56 user nova-compute[75100]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 17:32:56 user nova-compute[75100]:     <boot dev='hd'/>
Nov 13 17:32:56 user nova-compute[75100]:     <smbios mode='sysinfo'/>
Nov 13 17:32:56 user nova-compute[75100]:   </os>
Nov 13 17:32:56 user nova-compute[75100]:   <features>
Nov 13 17:32:56 user nova-compute[75100]:     <acpi/>
Nov 13 17:32:56 user nova-compute[75100]:     <apic/>
Nov 13 17:32:56 user nova-compute[75100]:     <vmcoreinfo state='on'/>
Nov 13 17:32:56 user nova-compute[75100]:   </features>
Nov 13 17:32:56 user nova-compute[75100]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 17:32:56 user nova-compute[75100]:     <model fallback='forbid'>Nehalem</model>
Nov 13 17:32:56 user nova-compute[75100]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 17:32:56 user nova-compute[75100]:     <feature policy='require' name='vme'/>
Nov 13 17:32:56 user nova-compute[75100]:     <feature policy='require' name='x2apic'/>
Nov 13 17:32:56 user nova-compute[75100]:     <feature policy='require' name='hypervisor'/>
Nov 13 17:32:56 user nova-compute[75100]:   </cpu>
Nov 13 17:32:56 user nova-compute[75100]:   <clock offset='utc'>
Nov 13 17:32:56 user nova-compute[75100]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 17:32:56 user nova-compute[75100]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 17:32:56 user nova-compute[75100]:     <timer name='hpet' present='no'/>
Nov 13 17:32:56 user nova-compute[75100]:   </clock>
Nov 13 17:32:56 user nova-compute[75100]:   <on_poweroff>destroy</on_poweroff>
Nov 13 17:32:56 user nova-compute[75100]:   <on_reboot>restart</on_reboot>
Nov 13 17:32:56 user nova-compute[75100]:   <on_crash>destroy</on_crash>
Nov 13 17:32:56 user nova-compute[75100]:   <devices>
Nov 13 17:32:56 user nova-compute[75100]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 17:32:56 user nova-compute[75100]:     <disk type='file' device='disk'>
Nov 13 17:32:56 user nova-compute[75100]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 17:32:56 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk' index='2'/>
Nov 13 17:32:56 user nova-compute[75100]:       <backingStore type='file' index='3'>
Nov 13 17:32:56 user nova-compute[75100]:         <format type='raw'/>
Nov 13 17:32:56 user nova-compute[75100]:         <source file='/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9'/>
Nov 13 17:32:56 user nova-compute[75100]:         <backingStore/>
Nov 13 17:32:56 user nova-compute[75100]:       </backingStore>
Nov 13 17:32:56 user nova-compute[75100]:       <target dev='vda' bus='virtio'/>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='virtio-disk0'/>
Nov 13 17:32:56 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 17:32:56 user nova-compute[75100]:     </disk>
Nov 13 17:32:56 user nova-compute[75100]:     <disk type='file' device='cdrom'>
Nov 13 17:32:56 user nova-compute[75100]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 17:32:56 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk.config' index='1'/>
Nov 13 17:32:56 user nova-compute[75100]:       <backingStore/>
Nov 13 17:32:56 user nova-compute[75100]:       <target dev='hda' bus='ide'/>
Nov 13 17:32:56 user nova-compute[75100]:       <readonly/>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='ide0-0-0'/>
Nov 13 17:32:56 user nova-compute[75100]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 17:32:56 user nova-compute[75100]:     </disk>
Nov 13 17:32:56 user nova-compute[75100]:     <controller type='usb' index='0' model='none'>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='usb'/>
Nov 13 17:32:56 user nova-compute[75100]:     </controller>
Nov 13 17:32:56 user nova-compute[75100]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='pci.0'/>
Nov 13 17:32:56 user nova-compute[75100]:     </controller>
Nov 13 17:32:56 user nova-compute[75100]:     <controller type='ide' index='0'>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='ide'/>
Nov 13 17:32:56 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 17:32:56 user nova-compute[75100]:     </controller>
Nov 13 17:32:56 user nova-compute[75100]:     <interface type='ethernet'>
Nov 13 17:32:56 user nova-compute[75100]:       <mac address='fa:16:3e:3b:85:9d'/>
Nov 13 17:32:56 user nova-compute[75100]:       <target dev='tap06242103-07'/>
Nov 13 17:32:56 user nova-compute[75100]:       <model type='virtio'/>
Nov 13 17:32:56 user nova-compute[75100]:       <mtu size='1442'/>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='net0'/>
Nov 13 17:32:56 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 17:32:56 user nova-compute[75100]:     </interface>
Nov 13 17:32:56 user nova-compute[75100]:     <interface type='ethernet'>
Nov 13 17:32:56 user nova-compute[75100]:       <mac address='fa:16:3e:f9:d0:54'/>
Nov 13 17:32:56 user nova-compute[75100]:       <target dev='tapfea81257-da'/>
Nov 13 17:32:56 user nova-compute[75100]:       <model type='virtio'/>
Nov 13 17:32:56 user nova-compute[75100]:       <mtu size='1442'/>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='net1'/>
Nov 13 17:32:56 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 13 17:32:56 user nova-compute[75100]:     </interface>
Nov 13 17:32:56 user nova-compute[75100]:     <serial type='pty'>
Nov 13 17:32:56 user nova-compute[75100]:       <source path='/dev/pts/5'/>
Nov 13 17:32:56 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/console.log' append='off'/>
Nov 13 17:32:56 user nova-compute[75100]:       <target type='isa-serial' port='0'>
Nov 13 17:32:56 user nova-compute[75100]:         <model name='isa-serial'/>
Nov 13 17:32:56 user nova-compute[75100]:       </target>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='serial0'/>
Nov 13 17:32:56 user nova-compute[75100]:     </serial>
Nov 13 17:32:56 user nova-compute[75100]:     <console type='pty' tty='/dev/pts/5'>
Nov 13 17:32:56 user nova-compute[75100]:       <source path='/dev/pts/5'/>
Nov 13 17:32:56 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/console.log' append='off'/>
Nov 13 17:32:56 user nova-compute[75100]:       <target type='serial' port='0'/>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='serial0'/>
Nov 13 17:32:56 user nova-compute[75100]:     </console>
Nov 13 17:32:56 user nova-compute[75100]:     <input type='mouse' bus='ps2'>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='input0'/>
Nov 13 17:32:56 user nova-compute[75100]:     </input>
Nov 13 17:32:56 user nova-compute[75100]:     <input type='keyboard' bus='ps2'>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='input1'/>
Nov 13 17:32:56 user nova-compute[75100]:     </input>
Nov 13 17:32:56 user nova-compute[75100]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 13 17:32:56 user nova-compute[75100]:       <listen type='address' address='0.0.0.0'/>
Nov 13 17:32:56 user nova-compute[75100]:     </graphics>
Nov 13 17:32:56 user nova-compute[75100]:     <audio id='1' type='none'/>
Nov 13 17:32:56 user nova-compute[75100]:     <video>
Nov 13 17:32:56 user nova-compute[75100]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='video0'/>
Nov 13 17:32:56 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 17:32:56 user nova-compute[75100]:     </video>
Nov 13 17:32:56 user nova-compute[75100]:     <memballoon model='virtio'>
Nov 13 17:32:56 user nova-compute[75100]:       <stats period='10'/>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='balloon0'/>
Nov 13 17:32:56 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 17:32:56 user nova-compute[75100]:     </memballoon>
Nov 13 17:32:56 user nova-compute[75100]:     <rng model='virtio'>
Nov 13 17:32:56 user nova-compute[75100]:       <backend model='random'>/dev/urandom</backend>
Nov 13 17:32:56 user nova-compute[75100]:       <alias name='rng0'/>
Nov 13 17:32:56 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 17:32:56 user nova-compute[75100]:     </rng>
Nov 13 17:32:56 user nova-compute[75100]:   </devices>
Nov 13 17:32:56 user nova-compute[75100]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 17:32:56 user nova-compute[75100]:     <label>libvirt-bcb48f07-30a1-48a1-b739-49bf2513c013</label>
Nov 13 17:32:56 user nova-compute[75100]:     <imagelabel>libvirt-bcb48f07-30a1-48a1-b739-49bf2513c013</imagelabel>
Nov 13 17:32:56 user nova-compute[75100]:   </seclabel>
Nov 13 17:32:56 user nova-compute[75100]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 17:32:56 user nova-compute[75100]:     <label>+64055:+108</label>
Nov 13 17:32:56 user nova-compute[75100]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 17:32:56 user nova-compute[75100]:   </seclabel>
Nov 13 17:32:56 user nova-compute[75100]: </domain>
Nov 13 17:32:56 user nova-compute[75100]:  {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 17:32:56 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Successfully detached device tapfea81257-da from instance bcb48f07-30a1-48a1-b739-49bf2513c013 from the persistent domain config.
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] (1/8): Attempting to detach device tapfea81257-da with device alias net1 from instance bcb48f07-30a1-48a1-b739-49bf2513c013 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] detach device xml: <interface type="ethernet">
Nov 13 17:32:56 user nova-compute[75100]:   <mac address="fa:16:3e:f9:d0:54"/>
Nov 13 17:32:56 user nova-compute[75100]:   <model type="virtio"/>
Nov 13 17:32:56 user nova-compute[75100]:   <mtu size="1442"/>
Nov 13 17:32:56 user nova-compute[75100]:   <target dev="tapfea81257-da"/>
Nov 13 17:32:56 user nova-compute[75100]: </interface>
Nov 13 17:32:56 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Start waiting for the detach event from libvirt for device tapfea81257-da with device alias net1 for instance bcb48f07-30a1-48a1-b739-49bf2513c013 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:32:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:32:58 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Instance running successfully.
Nov 13 17:32:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Failed to set time: agent not configured {{(pid=75100) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3a9aa9ea-7355-4d05-8b61-ab90a43ac849 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] finish_migration finished successfully. {{(pid=75100) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received event network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] No waiting events found dispatching network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:32:58 user nova-compute[75100]: WARNING nova.compute.manager [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received unexpected event network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 for instance with vm_state active and task_state resize_finish.
Nov 13 17:32:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-vif-unplugged-fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] No waiting events found dispatching network-vif-unplugged-fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:32:58 user nova-compute[75100]: WARNING nova.compute.manager [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received unexpected event network-vif-unplugged-fea81257-dac0-4e3c-8b1e-ea23b00449a1 for instance with vm_state active and task_state None.
Nov 13 17:32:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-vif-plugged-fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] No waiting events found dispatching network-vif-plugged-fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:32:58 user nova-compute[75100]: WARNING nova.compute.manager [req-99a6213f-a5d6-44bb-a660-fbe39ccebc8b req-4c493a45-5954-4c5f-b1de-dc8b394e1c75 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received unexpected event network-vif-plugged-fea81257-dac0-4e3c-8b1e-ea23b00449a1 for instance with vm_state active and task_state None.
Nov 13 17:32:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHgPJfWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:32:58 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:32:58 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:32:58 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bb3de3-6847-4d0c-881a-1e4c43b78eaf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:32:58 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e44c781-fd15-47f2-a09f-7f066977c66e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da] added
Nov 13 17:32:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9365b93a-0369-4150-9917-92316a8f5781]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f9f367-6df4-4918-ad21-145acfd6f0c3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHgPJfWS {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHgPJfWS" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87b092e-80eb-4d0e-97d8-96a765c7a66a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MHgPJfWS'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebbe41b-3425-42a3-93a3-f56ce2243c35]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c66f1b6-9526-4423-ae23-c354fce0ca2b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2c9b2c-5549-4ba0-aa1c-85c4cc05da2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da, portal: 172.16.0.220,3260]
Nov 13 17:32:58 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da, portal: 172.16.0.220,3260] successful.
Nov 13 17:32:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0a75ba-1011-4f84-a0c4-44e647e166dd]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0179f452-8e92-41da-8cfd-af4758389a9a]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:32:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:32:58 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:32:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:32:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:32:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:32:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f42928-53d9-4c7b-ad4b-a2717f829d4c]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:32:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:32:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHgPJfWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:32:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26365623830633930', 'path': '/dev/sdg'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:33:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365623830633930', 'path': '/dev/sdg'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:33:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lazy-loading 'flavor' on Instance uuid 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:33:00 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:33:00 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:33:00 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:33:00 user nova-compute[75100]:   <serial>58db2acc-e6cc-45d7-990d-8eb67b54f4da</serial>
Nov 13 17:33:00 user nova-compute[75100]: </disk>
Nov 13 17:33:00 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:33:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:33:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:33:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] No VIF found with MAC fa:16:3e:da:ef:0d, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:33:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fabce99-6adf-4ef3-a649-459982e06674 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.159s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:01 user nova-compute[75100]: INFO nova.compute.manager [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Rescuing
Nov 13 17:33:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:33:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquired lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:33:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:33:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updating instance_info_cache with network_info: [{"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Releasing lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-4341cfa1-322f-487a-a784-242088b5d898 req-2e6205ba-0330-4a46-bc46-652836b00c60 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-unplugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4341cfa1-322f-487a-a784-242088b5d898 req-2e6205ba-0330-4a46-bc46-652836b00c60 service nova] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4341cfa1-322f-487a-a784-242088b5d898 req-2e6205ba-0330-4a46-bc46-652836b00c60 service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4341cfa1-322f-487a-a784-242088b5d898 req-2e6205ba-0330-4a46-bc46-652836b00c60 service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-4341cfa1-322f-487a-a784-242088b5d898 req-2e6205ba-0330-4a46-bc46-652836b00c60 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] No waiting events found dispatching network-vif-unplugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:02 user nova-compute[75100]: WARNING nova.compute.manager [req-4341cfa1-322f-487a-a784-242088b5d898 req-2e6205ba-0330-4a46-bc46-652836b00c60 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received unexpected event network-vif-unplugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 for instance with vm_state active and task_state rescuing.
Nov 13 17:33:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Instance destroyed successfully.
Nov 13 17:33:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Attempting a stable device rescue
Nov 13 17:33:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75100) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 17:33:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Creating image(s)
Nov 13 17:33:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "/opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "/opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG nova.objects.instance [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "27528f37d18282952c633615555d7b359ca82b45" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "27528f37d18282952c633615555d7b359ca82b45" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45.part --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG nova.virt.images [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] 809ec45c-d4ba-40ec-84fd-faa01a73da37 was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45.part /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-a3d89ed5-4791-49d9-b096-855e72768751 req-b6d0abd0-307d-4d7a-ba84-7b2e2699636d service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a3d89ed5-4791-49d9-b096-855e72768751 req-b6d0abd0-307d-4d7a-ba84-7b2e2699636d service nova] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a3d89ed5-4791-49d9-b096-855e72768751 req-b6d0abd0-307d-4d7a-ba84-7b2e2699636d service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a3d89ed5-4791-49d9-b096-855e72768751 req-b6d0abd0-307d-4d7a-ba84-7b2e2699636d service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-a3d89ed5-4791-49d9-b096-855e72768751 req-b6d0abd0-307d-4d7a-ba84-7b2e2699636d service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] No waiting events found dispatching network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:04 user nova-compute[75100]: WARNING nova.compute.manager [req-a3d89ed5-4791-49d9-b096-855e72768751 req-b6d0abd0-307d-4d7a-ba84-7b2e2699636d service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received unexpected event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 for instance with vm_state active and task_state rescuing.
Nov 13 17:33:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45.part /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45.converted" returned: 0 in 0.550s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "27528f37d18282952c633615555d7b359ca82b45" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "27528f37d18282952c633615555d7b359ca82b45" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "27528f37d18282952c633615555d7b359ca82b45" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45 --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45,backing_fmt=raw /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.rescue {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45,backing_fmt=raw /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.rescue" returned: 0 in 0.054s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "27528f37d18282952c633615555d7b359ca82b45" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.objects.instance [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lazy-loading 'migration_context' on Instance uuid 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.objects.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Object Instance<2f5b57a9-5bac-4275-a51a-3213d7f9414f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Start _get_guest_xml network_info=[{"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "vif_mac": "fa:16:3e:da:ef:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '809ec45c-d4ba-40ec-84fd-faa01a73da37', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'c3051ef0-fff3-41e1-8fde-5f5d89acfe4f', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHgPJfWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '2f5b57a9-5bac-4275-a51a-3213d7f9414f', 'attached_at': '', 'detached_at': '', 'volume_id': '58db2acc-e6cc-45d7-990d-8eb67b54f4da', 'serial': '58db2acc-e6cc-45d7-990d-8eb67b54f4da'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.objects.instance [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lazy-loading 'resources' on Instance uuid 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.objects.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Object Instance<2f5b57a9-5bac-4275-a51a-3213d7f9414f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.objects.instance [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lazy-loading 'numa_topology' on Instance uuid 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.objects.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Object Instance<2f5b57a9-5bac-4275-a51a-3213d7f9414f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:05 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:33:05 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.objects.instance [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.objects.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Object Instance<2f5b57a9-5bac-4275-a51a-3213d7f9414f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHgPJfWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:33:05 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:33:05 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:33:05 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4739105-f57a-4115-a410-ef3c9faaf8c8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = MHgPJfWS\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 17:33:05 user nova-compute[75100]: node.name = iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da
Nov 13 17:33:05 user nova-compute[75100]: node.tpgt = -1
Nov 13 17:33:05 user nova-compute[75100]: node.startup = automatic
Nov 13 17:33:05 user nova-compute[75100]: node.leading_login = No
Nov 13 17:33:05 user nova-compute[75100]: iface.iscsi_ifacename = default
Nov 13 17:33:05 user nova-compute[75100]: iface.net_ifacename = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.ipaddress = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.prefix_len = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.hwaddress = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.transport_name = tcp
Nov 13 17:33:05 user nova-compute[75100]: iface.initiatorname = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.state = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.vlan_id = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.vlan_priority = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.vlan_state = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.iface_num = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.mtu = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.port = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.bootproto = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.subnet_mask = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.gateway = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.dhcp_alt_client_id = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.dhcp_dns = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.dhcp_learn_iqn = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.dhcp_vendor_id_state = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.dhcp_vendor_id = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.dhcp_slp_da = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.fragmentation = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.gratuitous_arp = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.incoming_forwarding = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.tos_state = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.tos = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.ttl = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.delayed_ack = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.tcp_nagle = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.tcp_wsf_state = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.tcp_wsf = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.tcp_timer_scale = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.tcp_timestamp = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.redirect = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.def_task_mgmt_timeout = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.header_digest = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.data_digest = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.immediate_data = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.initial_r2t = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.data_seq_inorder = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.data_pdu_inorder = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.erl = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.max_receive_data_len = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.first_burst_len = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.max_outstanding_r2t = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.max_burst_len = 0
Nov 13 17:33:05 user nova-compute[75100]: iface.chap_auth = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.bidi_chap = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.strict_login_compliance = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.discovery_auth = <empty>
Nov 13 17:33:05 user nova-compute[75100]: iface.discovery_logout = <empty>
Nov 13 17:33:05 user nova-compute[75100]: node.discovery_address = <empty>
Nov 13 17:33:05 user nova-compute[75100]: node.discovery_port = 0
Nov 13 17:33:05 user nova-compute[75100]: node.discovery_type = static
Nov 13 17:33:05 user nova-compute[75100]: node.session.initial_cmdsn = 0
Nov 13 17:33:05 user nova-compute[75100]: node.session.initial_login_retry_max = 8
Nov 13 17:33:05 user nova-compute[75100]: node.session.xmit_thread_priority = -20
Nov 13 17:33:05 user nova-compute[75100]: node.session.cmds_max = 128
Nov 13 17:33:05 user nova-compute[75100]: node.session.queue_depth = 32
Nov 13 17:33:05 user nova-compute[75100]: node.session.nr_sessions = 1
Nov 13 17:33:05 user nova-compute[75100]: node.session.auth.authmethod = CHAP
Nov 13 17:33:05 user nova-compute[75100]: node.session.auth.username = MHgPJfWS
Nov 13 17:33:05 user nova-compute[75100]: node.session.auth.password = ***
Nov 13 17:33:05 user nova-compute[75100]: node.session.auth.username_in = <empty>
Nov 13 17:33:05 user nova-compute[75100]: node.session.auth.password_in = <empty>
Nov 13 17:33:05 user nova-compute[75100]: node.session.auth.chap_algs = MD5
Nov 13 17:33:05 user nova-compute[75100]: node.session.timeo.replacement_timeout = 120
Nov 13 17:33:05 user nova-compute[75100]: node.session.err_timeo.abort_timeout = 15
Nov 13 17:33:05 user nova-compute[75100]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 17:33:05 user nova-compute[75100]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 17:33:05 user nova-compute[75100]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 17:33:05 user nova-compute[75100]: node.session.iscsi.FastAbort = Yes
Nov 13 17:33:05 user nova-compute[75100]: node.session.iscsi.InitialR2T = No
Nov 13 17:33:05 user nova-compute[75100]: node.session.iscsi.ImmediateData = Yes
Nov 13 17:33:05 user nova-compute[75100]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 17:33:05 user nova-compute[75100]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 17:33:05 user nova-compute[75100]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 17:33:05 user nova-compute[75100]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 17:33:05 user nova-compute[75100]: node.session.iscsi.MaxConnections = 1
Nov 13 17:33:05 user nova-compute[75100]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 17:33:05 user nova-compute[75100]: node.session.iscsi.ERL = 0
Nov 13 17:33:05 user nova-compute[75100]: node.session.scan = manual
Nov 13 17:33:05 user nova-compute[75100]: node.session.reopen_max = 0
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].address = 172.16.0.220
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].port = 3260
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].startup = manual
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].tcp.window_size = 524288
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].tcp.type_of_service = 0
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].timeo.logout_timeout = 15
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].timeo.login_timeout = 15
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].timeo.auth_timeout = 45
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].iscsi.DataDigest = None
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].iscsi.IFMarker = No
Nov 13 17:33:05 user nova-compute[75100]: node.conn[0].iscsi.OFMarker = No
Nov 13 17:33:05 user nova-compute[75100]: # END RECORD
Nov 13 17:33:05 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32cb675-d4ad-4620-8854-0960e1c4040e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5a4834-0c91-43ef-a25a-3a4727649da4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHgPJfWS {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MHgPJfWS" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8594fe7e-b8b3-415d-b0d4-5c9a19b0b7b5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MHgPJfWS'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[de283499-6ebd-423f-8f4d-e606ff60c43b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3138ce1a-9852-46f6-9d7b-b97b45c5dc24]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:05 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:05 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:05 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:05 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:05 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:05 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:05 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:05 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:05 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:05 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:05 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:05 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.169s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] HCTL ('38', '0', '0', 0) found on session 38 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a3272-349e-4963-ba17-15a13be40863]: (4, ('0 0 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Searching for a device in session 38 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHgPJfWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.200s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] <== connect_volume: return (201ms) {'type': 'block', 'scsi_wwn': '26365623830633930', 'path': '/dev/sdg'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365623830633930', 'path': '/dev/sdg'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-234989406',display_name='tempest-ServerStableDeviceRescueTest-server-234989406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-234989406',id=27,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTMZqt3AhpfLX/zImDo+vtV1+wrh9vw8+PaC+kdhYPk4LTG5ahylEV0Kp0Dh27kGA7KM8ig1B7ReH+DTmuQb6ye8DfVW79pPWGcZ5HGnRrkbDfk2JwiCFo2IeHoktdACQ==',key_name='tempest-keypair-831100549',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:29:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb93f95f4f604b9f99a2c9a6fdc96ae8',ramdisk_id='',reservation_id='r-yclingnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-766369628',owner_user_name='tempest-ServerStableDeviceRescueTest-766369628-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:31:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ea90d2812646af874d709df2efe59e',uuid=2f5b57a9-5bac-4275-a51a-3213d7f9414f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "vif_mac": "fa:16:3e:da:ef:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Converting VIF {"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "vif_mac": "fa:16:3e:da:ef:0d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:ef:0d,bridge_name='br-int',has_traffic_filtering=True,id=0e4ff1c7-53c8-45ff-818e-03d897b1e954,network=Network(6322d48b-3e6b-499b-a809-69289dee5119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4ff1c7-53') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.objects.instance [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.objects.base [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Object Instance<2f5b57a9-5bac-4275-a51a-3213d7f9414f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:33:05 user nova-compute[75100]:   <uuid>2f5b57a9-5bac-4275-a51a-3213d7f9414f</uuid>
Nov 13 17:33:05 user nova-compute[75100]:   <name>instance-0000001b</name>
Nov 13 17:33:05 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:33:05 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:33:05 user nova-compute[75100]:   <metadata>
Nov 13 17:33:05 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:33:05 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:33:05 user nova-compute[75100]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-234989406</nova:name>
Nov 13 17:33:05 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:33:05</nova:creationTime>
Nov 13 17:33:05 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:33:05 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:33:05 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:33:05 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:33:05 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:33:05 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:33:05 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:33:05 user nova-compute[75100]:       <nova:owner>
Nov 13 17:33:05 user nova-compute[75100]:         <nova:user uuid="39ea90d2812646af874d709df2efe59e">tempest-ServerStableDeviceRescueTest-766369628-project-member</nova:user>
Nov 13 17:33:05 user nova-compute[75100]:         <nova:project uuid="cb93f95f4f604b9f99a2c9a6fdc96ae8">tempest-ServerStableDeviceRescueTest-766369628</nova:project>
Nov 13 17:33:05 user nova-compute[75100]:       </nova:owner>
Nov 13 17:33:05 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:33:05 user nova-compute[75100]:       <nova:ports>
Nov 13 17:33:05 user nova-compute[75100]:         <nova:port uuid="0e4ff1c7-53c8-45ff-818e-03d897b1e954">
Nov 13 17:33:05 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:33:05 user nova-compute[75100]:         </nova:port>
Nov 13 17:33:05 user nova-compute[75100]:       </nova:ports>
Nov 13 17:33:05 user nova-compute[75100]:     </nova:instance>
Nov 13 17:33:05 user nova-compute[75100]:   </metadata>
Nov 13 17:33:05 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:33:05 user nova-compute[75100]:     <system>
Nov 13 17:33:05 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:33:05 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:33:05 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:33:05 user nova-compute[75100]:       <entry name="serial">2f5b57a9-5bac-4275-a51a-3213d7f9414f</entry>
Nov 13 17:33:05 user nova-compute[75100]:       <entry name="uuid">2f5b57a9-5bac-4275-a51a-3213d7f9414f</entry>
Nov 13 17:33:05 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:33:05 user nova-compute[75100]:     </system>
Nov 13 17:33:05 user nova-compute[75100]:   </sysinfo>
Nov 13 17:33:05 user nova-compute[75100]:   <os>
Nov 13 17:33:05 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:33:05 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:33:05 user nova-compute[75100]:   </os>
Nov 13 17:33:05 user nova-compute[75100]:   <features>
Nov 13 17:33:05 user nova-compute[75100]:     <acpi/>
Nov 13 17:33:05 user nova-compute[75100]:     <apic/>
Nov 13 17:33:05 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:33:05 user nova-compute[75100]:   </features>
Nov 13 17:33:05 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:33:05 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:33:05 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:33:05 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:33:05 user nova-compute[75100]:   </clock>
Nov 13 17:33:05 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:33:05 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:33:05 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:33:05 user nova-compute[75100]:   </cpu>
Nov 13 17:33:05 user nova-compute[75100]:   <devices>
Nov 13 17:33:05 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:33:05 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:33:05 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk"/>
Nov 13 17:33:05 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:33:05 user nova-compute[75100]:     </disk>
Nov 13 17:33:05 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:33:05 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:33:05 user nova-compute[75100]:       <source dev="/dev/sdg"/>
Nov 13 17:33:05 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:33:05 user nova-compute[75100]:       <serial>58db2acc-e6cc-45d7-990d-8eb67b54f4da</serial>
Nov 13 17:33:05 user nova-compute[75100]:     </disk>
Nov 13 17:33:05 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:33:05 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:33:05 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.rescue"/>
Nov 13 17:33:05 user nova-compute[75100]:       <target dev="vdc" bus="virtio"/>
Nov 13 17:33:05 user nova-compute[75100]:       <boot order="1"/>
Nov 13 17:33:05 user nova-compute[75100]:     </disk>
Nov 13 17:33:05 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:33:05 user nova-compute[75100]:       <mac address="fa:16:3e:da:ef:0d"/>
Nov 13 17:33:05 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:33:05 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:33:05 user nova-compute[75100]:       <target dev="tap0e4ff1c7-53"/>
Nov 13 17:33:05 user nova-compute[75100]:     </interface>
Nov 13 17:33:05 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:33:05 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/console.log" append="off"/>
Nov 13 17:33:05 user nova-compute[75100]:     </serial>
Nov 13 17:33:05 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:33:05 user nova-compute[75100]:     <video>
Nov 13 17:33:05 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:33:05 user nova-compute[75100]:     </video>
Nov 13 17:33:05 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:33:05 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:33:05 user nova-compute[75100]:     </rng>
Nov 13 17:33:05 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:33:05 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:33:05 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:33:05 user nova-compute[75100]:     </memballoon>
Nov 13 17:33:05 user nova-compute[75100]:   </devices>
Nov 13 17:33:05 user nova-compute[75100]: </domain>
Nov 13 17:33:05 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:33:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Instance destroyed successfully.
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:33:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] No VIF found with MAC fa:16:3e:da:ef:0d, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:33:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-5eff7076-f4a1-4325-ba35-aa7a2a1674ba req-777767f3-266e-4864-a54e-6de20f857a3a service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5eff7076-f4a1-4325-ba35-aa7a2a1674ba req-777767f3-266e-4864-a54e-6de20f857a3a service nova] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5eff7076-f4a1-4325-ba35-aa7a2a1674ba req-777767f3-266e-4864-a54e-6de20f857a3a service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5eff7076-f4a1-4325-ba35-aa7a2a1674ba req-777767f3-266e-4864-a54e-6de20f857a3a service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-5eff7076-f4a1-4325-ba35-aa7a2a1674ba req-777767f3-266e-4864-a54e-6de20f857a3a service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] No waiting events found dispatching network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:07 user nova-compute[75100]: WARNING nova.compute.manager [req-5eff7076-f4a1-4325-ba35-aa7a2a1674ba req-777767f3-266e-4864-a54e-6de20f857a3a service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received unexpected event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 for instance with vm_state active and task_state rescuing.
Nov 13 17:33:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-38371352-1f78-4bf5-9da6-c813477342a8 req-c8a5f7f9-2afc-4d57-8663-ecb0370d0571 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-38371352-1f78-4bf5-9da6-c813477342a8 req-c8a5f7f9-2afc-4d57-8663-ecb0370d0571 service nova] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-38371352-1f78-4bf5-9da6-c813477342a8 req-c8a5f7f9-2afc-4d57-8663-ecb0370d0571 service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-38371352-1f78-4bf5-9da6-c813477342a8 req-c8a5f7f9-2afc-4d57-8663-ecb0370d0571 service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-38371352-1f78-4bf5-9da6-c813477342a8 req-c8a5f7f9-2afc-4d57-8663-ecb0370d0571 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] No waiting events found dispatching network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:09 user nova-compute[75100]: WARNING nova.compute.manager [req-38371352-1f78-4bf5-9da6-c813477342a8 req-c8a5f7f9-2afc-4d57-8663-ecb0370d0571 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received unexpected event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 for instance with vm_state active and task_state rescuing.
Nov 13 17:33:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-a6b1c89b-ca42-4b60-9468-b70aa170a9d8 req-f22cda2d-b69f-4dde-aa87-e8eb4deac4d8 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-changed-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-a6b1c89b-ca42-4b60-9468-b70aa170a9d8 req-f22cda2d-b69f-4dde-aa87-e8eb4deac4d8 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Refreshing instance network info cache due to event network-changed-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a6b1c89b-ca42-4b60-9468-b70aa170a9d8 req-f22cda2d-b69f-4dde-aa87-e8eb4deac4d8 service nova] Acquiring lock "refresh_cache-8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a6b1c89b-ca42-4b60-9468-b70aa170a9d8 req-f22cda2d-b69f-4dde-aa87-e8eb4deac4d8 service nova] Acquired lock "refresh_cache-8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG nova.network.neutron [req-a6b1c89b-ca42-4b60-9468-b70aa170a9d8 req-f22cda2d-b69f-4dde-aa87-e8eb4deac4d8 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Refreshing network info cache for port f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-268541f1-c0f8-461b-82fb-556dd21cf01d tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG nova.network.neutron [req-a6b1c89b-ca42-4b60-9468-b70aa170a9d8 req-f22cda2d-b69f-4dde-aa87-e8eb4deac4d8 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Updated VIF entry in instance network info cache for port f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG nova.network.neutron [req-a6b1c89b-ca42-4b60-9468-b70aa170a9d8 req-f22cda2d-b69f-4dde-aa87-e8eb4deac4d8 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Updating instance_info_cache with network_info: [{"id": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "address": "fa:16:3e:9e:88:54", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a85f7-5b", "ovs_interfaceid": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a6b1c89b-ca42-4b60-9468-b70aa170a9d8 req-f22cda2d-b69f-4dde-aa87-e8eb4deac4d8 service nova] Releasing lock "refresh_cache-8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:33:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG nova.objects.instance [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'flavor' on Instance uuid a5f308a2-3b44-476e-85ab-15e1bf107968 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:33:14 user nova-compute[75100]: INFO nova.compute.claims [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Claim successful on node user
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:14 user nova-compute[75100]: INFO nova.compute.manager [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Attaching volume 9deacb14-d81b-46e6-9701-ec9ce76ebab2 to /dev/vdb
Nov 13 17:33:14 user nova-compute[75100]: DEBUG os_brick.utils [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[251e04c6-dbbb-46ba-ad09-1b6574c9f455]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9946f0-a4ae-4c1a-bab0-a2a2a9f1422c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b27853d-3587-43b7-821c-dc27149049e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0900bcd2-c3d6-4885-887f-58cc389700f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:33:14 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f224cb-c891-4d4f-9e76-360ebdbd5257]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG os_brick.utils [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updating existing volume attachment record: e19317a6-6e09-4b14-a149-aa329ea40335 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:33:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:33:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:33:14 user nova-compute[75100]: DEBUG nova.policy [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '421484d1f180498fa5e078c084d70986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20bd8fd1a36f49a08be3d97799e847a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:33:14 user nova-compute[75100]: INFO nova.virt.block_device [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Booting with volume 973314de-8205-4322-91eb-a9566496a56c at /dev/vda
Nov 13 17:33:15 user nova-compute[75100]: DEBUG os_brick.utils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcef4002-7526-498f-a5cd-0983a21c117c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[affcf28a-644a-4045-bf79-522e2f284c86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[196172b9-06ca-4a1b-92a5-b44a5520d910]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f0204c-b229-472c-b012-441c513f1cae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:33:15 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:33:15 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88439a1-b1e3-443a-be69-92c5f59bbe4b]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG os_brick.utils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Updating existing volume attachment record: 7bd858fa-6854-4068-9169-f4f07e618eeb {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:33:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Successfully created port: 5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Successfully updated port: 5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "refresh_cache-6b7d6fb7-30cb-46bd-8ec9-11d60f160350" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquired lock "refresh_cache-6b7d6fb7-30cb-46bd-8ec9-11d60f160350" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-ba8f31aa-fd9b-465e-b9a2-b8c017c6babe req-80c76f2a-9953-4542-8c73-e426095784ed service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Received event network-changed-5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-ba8f31aa-fd9b-465e-b9a2-b8c017c6babe req-80c76f2a-9953-4542-8c73-e426095784ed service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Refreshing instance network info cache due to event network-changed-5a265285-9a4e-46b3-bd04-3b3f3608aaba. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ba8f31aa-fd9b-465e-b9a2-b8c017c6babe req-80c76f2a-9953-4542-8c73-e426095784ed service nova] Acquiring lock "refresh_cache-6b7d6fb7-30cb-46bd-8ec9-11d60f160350" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Updating instance_info_cache with network_info: [{"id": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "address": "fa:16:3e:38:31:d4", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a265285-9a", "ovs_interfaceid": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Releasing lock "refresh_cache-6b7d6fb7-30cb-46bd-8ec9-11d60f160350" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Instance network_info: |[{"id": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "address": "fa:16:3e:38:31:d4", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a265285-9a", "ovs_interfaceid": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ba8f31aa-fd9b-465e-b9a2-b8c017c6babe req-80c76f2a-9953-4542-8c73-e426095784ed service nova] Acquired lock "refresh_cache-6b7d6fb7-30cb-46bd-8ec9-11d60f160350" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-ba8f31aa-fd9b-465e-b9a2-b8c017c6babe req-80c76f2a-9953-4542-8c73-e426095784ed service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Refreshing network info cache for port 5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:33:16 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Waiting for libvirt event about the detach of device tapfea81257-da with device alias net1 from instance bcb48f07-30a1-48a1-b739-49bf2513c013 is timed out.
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f9:d0:54"/><model type="virtio"/><mtu size="1442"/><target dev="tapfea81257-da"/></interface> {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f9:d0:54"/><model type="virtio"/><mtu size="1442"/><target dev="tapfea81257-da"/></interface>not found in domain: <domain type='kvm' id='39'>
Nov 13 17:33:16 user nova-compute[75100]:   <name>instance-0000001c</name>
Nov 13 17:33:16 user nova-compute[75100]:   <uuid>bcb48f07-30a1-48a1-b739-49bf2513c013</uuid>
Nov 13 17:33:16 user nova-compute[75100]:   <metadata>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:33:16 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 13 17:33:16 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1119793217</nova:name>
Nov 13 17:33:16 user nova-compute[75100]:   <nova:creationTime>2023-11-13 17:32:25</nova:creationTime>
Nov 13 17:33:16 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 13 17:33:16 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 13 17:33:16 user nova-compute[75100]:   </nova:flavor>
Nov 13 17:33:16 user nova-compute[75100]:   <nova:owner>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:user uuid="b10372a7ca7845d8970b4f957afd249d">tempest-TaggedAttachmentsTest-1699715910-project-member</nova:user>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:project uuid="48b8e980410348b48bf04fc382c4e60c">tempest-TaggedAttachmentsTest-1699715910</nova:project>
Nov 13 17:33:16 user nova-compute[75100]:   </nova:owner>
Nov 13 17:33:16 user nova-compute[75100]:   <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:33:16 user nova-compute[75100]:   <nova:ports>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:port uuid="06242103-0705-434a-8b09-54be30f73283">
Nov 13 17:33:16 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 17:33:16 user nova-compute[75100]:     </nova:port>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:port uuid="fea81257-dac0-4e3c-8b1e-ea23b00449a1">
Nov 13 17:33:16 user nova-compute[75100]:       <nova:ip type="fixed" address="10.10.10.93" ipVersion="4"/>
Nov 13 17:33:16 user nova-compute[75100]:     </nova:port>
Nov 13 17:33:16 user nova-compute[75100]:   </nova:ports>
Nov 13 17:33:16 user nova-compute[75100]: </nova:instance>
Nov 13 17:33:16 user nova-compute[75100]:   </metadata>
Nov 13 17:33:16 user nova-compute[75100]:   <memory unit='KiB'>524288</memory>
Nov 13 17:33:16 user nova-compute[75100]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 17:33:16 user nova-compute[75100]:   <vcpu placement='static'>1</vcpu>
Nov 13 17:33:16 user nova-compute[75100]:   <resource>
Nov 13 17:33:16 user nova-compute[75100]:     <partition>/machine</partition>
Nov 13 17:33:16 user nova-compute[75100]:   </resource>
Nov 13 17:33:16 user nova-compute[75100]:   <sysinfo type='smbios'>
Nov 13 17:33:16 user nova-compute[75100]:     <system>
Nov 13 17:33:16 user nova-compute[75100]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 17:33:16 user nova-compute[75100]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 17:33:16 user nova-compute[75100]:       <entry name='version'>0.0.0</entry>
Nov 13 17:33:16 user nova-compute[75100]:       <entry name='serial'>bcb48f07-30a1-48a1-b739-49bf2513c013</entry>
Nov 13 17:33:16 user nova-compute[75100]:       <entry name='uuid'>bcb48f07-30a1-48a1-b739-49bf2513c013</entry>
Nov 13 17:33:16 user nova-compute[75100]:       <entry name='family'>Virtual Machine</entry>
Nov 13 17:33:16 user nova-compute[75100]:     </system>
Nov 13 17:33:16 user nova-compute[75100]:   </sysinfo>
Nov 13 17:33:16 user nova-compute[75100]:   <os>
Nov 13 17:33:16 user nova-compute[75100]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 17:33:16 user nova-compute[75100]:     <boot dev='hd'/>
Nov 13 17:33:16 user nova-compute[75100]:     <smbios mode='sysinfo'/>
Nov 13 17:33:16 user nova-compute[75100]:   </os>
Nov 13 17:33:16 user nova-compute[75100]:   <features>
Nov 13 17:33:16 user nova-compute[75100]:     <acpi/>
Nov 13 17:33:16 user nova-compute[75100]:     <apic/>
Nov 13 17:33:16 user nova-compute[75100]:     <vmcoreinfo state='on'/>
Nov 13 17:33:16 user nova-compute[75100]:   </features>
Nov 13 17:33:16 user nova-compute[75100]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 17:33:16 user nova-compute[75100]:     <model fallback='forbid'>Nehalem</model>
Nov 13 17:33:16 user nova-compute[75100]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 17:33:16 user nova-compute[75100]:     <feature policy='require' name='vme'/>
Nov 13 17:33:16 user nova-compute[75100]:     <feature policy='require' name='x2apic'/>
Nov 13 17:33:16 user nova-compute[75100]:     <feature policy='require' name='hypervisor'/>
Nov 13 17:33:16 user nova-compute[75100]:   </cpu>
Nov 13 17:33:16 user nova-compute[75100]:   <clock offset='utc'>
Nov 13 17:33:16 user nova-compute[75100]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 17:33:16 user nova-compute[75100]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 17:33:16 user nova-compute[75100]:     <timer name='hpet' present='no'/>
Nov 13 17:33:16 user nova-compute[75100]:   </clock>
Nov 13 17:33:16 user nova-compute[75100]:   <on_poweroff>destroy</on_poweroff>
Nov 13 17:33:16 user nova-compute[75100]:   <on_reboot>restart</on_reboot>
Nov 13 17:33:16 user nova-compute[75100]:   <on_crash>destroy</on_crash>
Nov 13 17:33:16 user nova-compute[75100]:   <devices>
Nov 13 17:33:16 user nova-compute[75100]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 17:33:16 user nova-compute[75100]:     <disk type='file' device='disk'>
Nov 13 17:33:16 user nova-compute[75100]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 17:33:16 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk' index='2'/>
Nov 13 17:33:16 user nova-compute[75100]:       <backingStore type='file' index='3'>
Nov 13 17:33:16 user nova-compute[75100]:         <format type='raw'/>
Nov 13 17:33:16 user nova-compute[75100]:         <source file='/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9'/>
Nov 13 17:33:16 user nova-compute[75100]:         <backingStore/>
Nov 13 17:33:16 user nova-compute[75100]:       </backingStore>
Nov 13 17:33:16 user nova-compute[75100]:       <target dev='vda' bus='virtio'/>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='virtio-disk0'/>
Nov 13 17:33:16 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 17:33:16 user nova-compute[75100]:     </disk>
Nov 13 17:33:16 user nova-compute[75100]:     <disk type='file' device='cdrom'>
Nov 13 17:33:16 user nova-compute[75100]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 17:33:16 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk.config' index='1'/>
Nov 13 17:33:16 user nova-compute[75100]:       <backingStore/>
Nov 13 17:33:16 user nova-compute[75100]:       <target dev='hda' bus='ide'/>
Nov 13 17:33:16 user nova-compute[75100]:       <readonly/>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='ide0-0-0'/>
Nov 13 17:33:16 user nova-compute[75100]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 17:33:16 user nova-compute[75100]:     </disk>
Nov 13 17:33:16 user nova-compute[75100]:     <controller type='usb' index='0' model='none'>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='usb'/>
Nov 13 17:33:16 user nova-compute[75100]:     </controller>
Nov 13 17:33:16 user nova-compute[75100]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='pci.0'/>
Nov 13 17:33:16 user nova-compute[75100]:     </controller>
Nov 13 17:33:16 user nova-compute[75100]:     <controller type='ide' index='0'>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='ide'/>
Nov 13 17:33:16 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 17:33:16 user nova-compute[75100]:     </controller>
Nov 13 17:33:16 user nova-compute[75100]:     <interface type='ethernet'>
Nov 13 17:33:16 user nova-compute[75100]:       <mac address='fa:16:3e:3b:85:9d'/>
Nov 13 17:33:16 user nova-compute[75100]:       <target dev='tap06242103-07'/>
Nov 13 17:33:16 user nova-compute[75100]:       <model type='virtio'/>
Nov 13 17:33:16 user nova-compute[75100]:       <mtu size='1442'/>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='net0'/>
Nov 13 17:33:16 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 17:33:16 user nova-compute[75100]:     </interface>
Nov 13 17:33:16 user nova-compute[75100]:     <serial type='pty'>
Nov 13 17:33:16 user nova-compute[75100]:       <source path='/dev/pts/5'/>
Nov 13 17:33:16 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/console.log' append='off'/>
Nov 13 17:33:16 user nova-compute[75100]:       <target type='isa-serial' port='0'>
Nov 13 17:33:16 user nova-compute[75100]:         <model name='isa-serial'/>
Nov 13 17:33:16 user nova-compute[75100]:       </target>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='serial0'/>
Nov 13 17:33:16 user nova-compute[75100]:     </serial>
Nov 13 17:33:16 user nova-compute[75100]:     <console type='pty' tty='/dev/pts/5'>
Nov 13 17:33:16 user nova-compute[75100]:       <source path='/dev/pts/5'/>
Nov 13 17:33:16 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/console.log' append='off'/>
Nov 13 17:33:16 user nova-compute[75100]:       <target type='serial' port='0'/>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='serial0'/>
Nov 13 17:33:16 user nova-compute[75100]:     </console>
Nov 13 17:33:16 user nova-compute[75100]:     <input type='mouse' bus='ps2'>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='input0'/>
Nov 13 17:33:16 user nova-compute[75100]:     </input>
Nov 13 17:33:16 user nova-compute[75100]:     <input type='keyboard' bus='ps2'>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='input1'/>
Nov 13 17:33:16 user nova-compute[75100]:     </input>
Nov 13 17:33:16 user nova-compute[75100]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 13 17:33:16 user nova-compute[75100]:       <listen type='address' address='0.0.0.0'/>
Nov 13 17:33:16 user nova-compute[75100]:     </graphics>
Nov 13 17:33:16 user nova-compute[75100]:     <audio id='1' type='none'/>
Nov 13 17:33:16 user nova-compute[75100]:     <video>
Nov 13 17:33:16 user nova-compute[75100]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='video0'/>
Nov 13 17:33:16 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 17:33:16 user nova-compute[75100]:     </video>
Nov 13 17:33:16 user nova-compute[75100]:     <memballoon model='virtio'>
Nov 13 17:33:16 user nova-compute[75100]:       <stats period='10'/>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='balloon0'/>
Nov 13 17:33:16 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 17:33:16 user nova-compute[75100]:     </memballoon>
Nov 13 17:33:16 user nova-compute[75100]:     <rng model='virtio'>
Nov 13 17:33:16 user nova-compute[75100]:       <backend model='random'>/dev/urandom</backend>
Nov 13 17:33:16 user nova-compute[75100]:       <alias name='rng0'/>
Nov 13 17:33:16 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 17:33:16 user nova-compute[75100]:     </rng>
Nov 13 17:33:16 user nova-compute[75100]:   </devices>
Nov 13 17:33:16 user nova-compute[75100]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 17:33:16 user nova-compute[75100]:     <label>libvirt-bcb48f07-30a1-48a1-b739-49bf2513c013</label>
Nov 13 17:33:16 user nova-compute[75100]:     <imagelabel>libvirt-bcb48f07-30a1-48a1-b739-49bf2513c013</imagelabel>
Nov 13 17:33:16 user nova-compute[75100]:   </seclabel>
Nov 13 17:33:16 user nova-compute[75100]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 17:33:16 user nova-compute[75100]:     <label>+64055:+108</label>
Nov 13 17:33:16 user nova-compute[75100]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 17:33:16 user nova-compute[75100]:   </seclabel>
Nov 13 17:33:16 user nova-compute[75100]: </domain>
Nov 13 17:33:16 user nova-compute[75100]:  {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 17:33:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Successfully detached device tapfea81257-da from instance bcb48f07-30a1-48a1-b739-49bf2513c013 from the live domain config.
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1119793217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1119793217',id=28,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvx8JQIBkL21nN5cuKYIjTT8NnZAWSZMP2QkZAc6pbLZaJgU2fYiAQEBg0Xgdwf3KsbdPq5Sf/a+dIZy7MOu0OovA6J7QJWFX9Lec9YN4YQPY7+toKNUPqHUKmWixmRqw==',key_name='tempest-keypair-1552872187',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48b8e980410348b48bf04fc382c4e60c',ramdisk_id='',reservation_id='r-n03514yb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1699715910',owner_user_name='tempest-TaggedAttachmentsTest-1699715910-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b10372a7ca7845d8970b4f957afd249d',uuid=bcb48f07-30a1-48a1-b739-49bf2513c013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converting VIF {"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d0:54,bridge_name='br-int',has_traffic_filtering=True,id=fea81257-dac0-4e3c-8b1e-ea23b00449a1,network=Network(165302f5-40f8-42db-8278-b8c3710f0958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea81257-da') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG os_vif [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d0:54,bridge_name='br-int',has_traffic_filtering=True,id=fea81257-dac0-4e3c-8b1e-ea23b00449a1,network=Network(165302f5-40f8-42db-8278-b8c3710f0958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea81257-da') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfea81257-da, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4327fdd1-8e72-4229-a9bd-35d14fbcedf5) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:16 user nova-compute[75100]: INFO os_vif [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d0:54,bridge_name='br-int',has_traffic_filtering=True,id=fea81257-dac0-4e3c-8b1e-ea23b00449a1,network=Network(165302f5-40f8-42db-8278-b8c3710f0958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea81257-da')
Nov 13 17:33:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:33:16 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 13 17:33:16 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1119793217</nova:name>
Nov 13 17:33:16 user nova-compute[75100]:   <nova:creationTime>2023-11-13 17:33:16</nova:creationTime>
Nov 13 17:33:16 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 13 17:33:16 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 13 17:33:16 user nova-compute[75100]:   </nova:flavor>
Nov 13 17:33:16 user nova-compute[75100]:   <nova:owner>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:user uuid="b10372a7ca7845d8970b4f957afd249d">tempest-TaggedAttachmentsTest-1699715910-project-member</nova:user>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:project uuid="48b8e980410348b48bf04fc382c4e60c">tempest-TaggedAttachmentsTest-1699715910</nova:project>
Nov 13 17:33:16 user nova-compute[75100]:   </nova:owner>
Nov 13 17:33:16 user nova-compute[75100]:   <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:33:16 user nova-compute[75100]:   <nova:ports>
Nov 13 17:33:16 user nova-compute[75100]:     <nova:port uuid="06242103-0705-434a-8b09-54be30f73283">
Nov 13 17:33:16 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 17:33:16 user nova-compute[75100]:     </nova:port>
Nov 13 17:33:16 user nova-compute[75100]:   </nova:ports>
Nov 13 17:33:16 user nova-compute[75100]: </nova:instance>
Nov 13 17:33:16 user nova-compute[75100]:  {{(pid=75100) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 17:33:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-ba8f31aa-fd9b-465e-b9a2-b8c017c6babe req-80c76f2a-9953-4542-8c73-e426095784ed service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Updated VIF entry in instance network info cache for port 5a265285-9a4e-46b3-bd04-3b3f3608aaba. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:33:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-ba8f31aa-fd9b-465e-b9a2-b8c017c6babe req-80c76f2a-9953-4542-8c73-e426095784ed service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Updating instance_info_cache with network_info: [{"id": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "address": "fa:16:3e:38:31:d4", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a265285-9a", "ovs_interfaceid": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ba8f31aa-fd9b-465e-b9a2-b8c017c6babe req-80c76f2a-9953-4542-8c73-e426095784ed service nova] Releasing lock "refresh_cache-6b7d6fb7-30cb-46bd-8ec9-11d60f160350" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:33:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:33:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquired lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:33:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-vif-deleted-fea81257-dac0-4e3c-8b1e-ea23b00449a1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:18 user nova-compute[75100]: INFO nova.compute.manager [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Neutron deleted interface fea81257-dac0-4e3c-8b1e-ea23b00449a1; detaching it from the instance and deleting it from the info cache
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.network.neutron [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Updating instance_info_cache with network_info: [{"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:18 user nova-compute[75100]: INFO nova.network.neutron [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Port fea81257-dac0-4e3c-8b1e-ea23b00449a1 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Updating instance_info_cache with network_info: [{"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.objects.instance [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] Lazy-loading 'system_metadata' on Instance uuid bcb48f07-30a1-48a1-b739-49bf2513c013 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Releasing lock "refresh_cache-bcb48f07-30a1-48a1-b739-49bf2513c013" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ea73ea51-ed38-414d-ade5-03ebf2a5ceae tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "interface-bcb48f07-30a1-48a1-b739-49bf2513c013-fea81257-dac0-4e3c-8b1e-ea23b00449a1" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.objects.instance [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] Lazy-loading 'flavor' on Instance uuid bcb48f07-30a1-48a1-b739-49bf2513c013 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.objects.base [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] Object Instance<bcb48f07-30a1-48a1-b739-49bf2513c013> lazy-loaded attributes: system_metadata,flavor {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1119793217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1119793217',id=28,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvx8JQIBkL21nN5cuKYIjTT8NnZAWSZMP2QkZAc6pbLZaJgU2fYiAQEBg0Xgdwf3KsbdPq5Sf/a+dIZy7MOu0OovA6J7QJWFX9Lec9YN4YQPY7+toKNUPqHUKmWixmRqw==',key_name='tempest-keypair-1552872187',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48b8e980410348b48bf04fc382c4e60c',ramdisk_id='',reservation_id='r-n03514yb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1699715910',owner_user_name='tempest-TaggedAttachmentsTest-1699715910-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b10372a7ca7845d8970b4f957afd249d',uuid=bcb48f07-30a1-48a1-b739-49bf2513c013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.network.os_vif_util [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] Converting VIF {"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.network.os_vif_util [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d0:54,bridge_name='br-int',has_traffic_filtering=True,id=fea81257-dac0-4e3c-8b1e-ea23b00449a1,network=Network(165302f5-40f8-42db-8278-b8c3710f0958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea81257-da') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f9:d0:54"/><model type="virtio"/><mtu size="1442"/><target dev="tapfea81257-da"/></interface> {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f9:d0:54"/><model type="virtio"/><mtu size="1442"/><target dev="tapfea81257-da"/></interface>not found in domain: <domain type='kvm' id='39'>
Nov 13 17:33:18 user nova-compute[75100]:   <name>instance-0000001c</name>
Nov 13 17:33:18 user nova-compute[75100]:   <uuid>bcb48f07-30a1-48a1-b739-49bf2513c013</uuid>
Nov 13 17:33:18 user nova-compute[75100]:   <metadata>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:33:18 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1119793217</nova:name>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:creationTime>2023-11-13 17:33:16</nova:creationTime>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 13 17:33:18 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 13 17:33:18 user nova-compute[75100]:   </nova:flavor>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:owner>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:user uuid="b10372a7ca7845d8970b4f957afd249d">tempest-TaggedAttachmentsTest-1699715910-project-member</nova:user>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:project uuid="48b8e980410348b48bf04fc382c4e60c">tempest-TaggedAttachmentsTest-1699715910</nova:project>
Nov 13 17:33:18 user nova-compute[75100]:   </nova:owner>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:ports>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:port uuid="06242103-0705-434a-8b09-54be30f73283">
Nov 13 17:33:18 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 17:33:18 user nova-compute[75100]:     </nova:port>
Nov 13 17:33:18 user nova-compute[75100]:   </nova:ports>
Nov 13 17:33:18 user nova-compute[75100]: </nova:instance>
Nov 13 17:33:18 user nova-compute[75100]:   </metadata>
Nov 13 17:33:18 user nova-compute[75100]:   <memory unit='KiB'>524288</memory>
Nov 13 17:33:18 user nova-compute[75100]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 17:33:18 user nova-compute[75100]:   <vcpu placement='static'>1</vcpu>
Nov 13 17:33:18 user nova-compute[75100]:   <resource>
Nov 13 17:33:18 user nova-compute[75100]:     <partition>/machine</partition>
Nov 13 17:33:18 user nova-compute[75100]:   </resource>
Nov 13 17:33:18 user nova-compute[75100]:   <sysinfo type='smbios'>
Nov 13 17:33:18 user nova-compute[75100]:     <system>
Nov 13 17:33:18 user nova-compute[75100]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 17:33:18 user nova-compute[75100]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 17:33:18 user nova-compute[75100]:       <entry name='version'>0.0.0</entry>
Nov 13 17:33:18 user nova-compute[75100]:       <entry name='serial'>bcb48f07-30a1-48a1-b739-49bf2513c013</entry>
Nov 13 17:33:18 user nova-compute[75100]:       <entry name='uuid'>bcb48f07-30a1-48a1-b739-49bf2513c013</entry>
Nov 13 17:33:18 user nova-compute[75100]:       <entry name='family'>Virtual Machine</entry>
Nov 13 17:33:18 user nova-compute[75100]:     </system>
Nov 13 17:33:18 user nova-compute[75100]:   </sysinfo>
Nov 13 17:33:18 user nova-compute[75100]:   <os>
Nov 13 17:33:18 user nova-compute[75100]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 17:33:18 user nova-compute[75100]:     <boot dev='hd'/>
Nov 13 17:33:18 user nova-compute[75100]:     <smbios mode='sysinfo'/>
Nov 13 17:33:18 user nova-compute[75100]:   </os>
Nov 13 17:33:18 user nova-compute[75100]:   <features>
Nov 13 17:33:18 user nova-compute[75100]:     <acpi/>
Nov 13 17:33:18 user nova-compute[75100]:     <apic/>
Nov 13 17:33:18 user nova-compute[75100]:     <vmcoreinfo state='on'/>
Nov 13 17:33:18 user nova-compute[75100]:   </features>
Nov 13 17:33:18 user nova-compute[75100]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 17:33:18 user nova-compute[75100]:     <model fallback='forbid'>Nehalem</model>
Nov 13 17:33:18 user nova-compute[75100]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 17:33:18 user nova-compute[75100]:     <feature policy='require' name='vme'/>
Nov 13 17:33:18 user nova-compute[75100]:     <feature policy='require' name='x2apic'/>
Nov 13 17:33:18 user nova-compute[75100]:     <feature policy='require' name='hypervisor'/>
Nov 13 17:33:18 user nova-compute[75100]:   </cpu>
Nov 13 17:33:18 user nova-compute[75100]:   <clock offset='utc'>
Nov 13 17:33:18 user nova-compute[75100]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 17:33:18 user nova-compute[75100]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 17:33:18 user nova-compute[75100]:     <timer name='hpet' present='no'/>
Nov 13 17:33:18 user nova-compute[75100]:   </clock>
Nov 13 17:33:18 user nova-compute[75100]:   <on_poweroff>destroy</on_poweroff>
Nov 13 17:33:18 user nova-compute[75100]:   <on_reboot>restart</on_reboot>
Nov 13 17:33:18 user nova-compute[75100]:   <on_crash>destroy</on_crash>
Nov 13 17:33:18 user nova-compute[75100]:   <devices>
Nov 13 17:33:18 user nova-compute[75100]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 17:33:18 user nova-compute[75100]:     <disk type='file' device='disk'>
Nov 13 17:33:18 user nova-compute[75100]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 17:33:18 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk' index='2'/>
Nov 13 17:33:18 user nova-compute[75100]:       <backingStore type='file' index='3'>
Nov 13 17:33:18 user nova-compute[75100]:         <format type='raw'/>
Nov 13 17:33:18 user nova-compute[75100]:         <source file='/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9'/>
Nov 13 17:33:18 user nova-compute[75100]:         <backingStore/>
Nov 13 17:33:18 user nova-compute[75100]:       </backingStore>
Nov 13 17:33:18 user nova-compute[75100]:       <target dev='vda' bus='virtio'/>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='virtio-disk0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </disk>
Nov 13 17:33:18 user nova-compute[75100]:     <disk type='file' device='cdrom'>
Nov 13 17:33:18 user nova-compute[75100]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 17:33:18 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk.config' index='1'/>
Nov 13 17:33:18 user nova-compute[75100]:       <backingStore/>
Nov 13 17:33:18 user nova-compute[75100]:       <target dev='hda' bus='ide'/>
Nov 13 17:33:18 user nova-compute[75100]:       <readonly/>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='ide0-0-0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </disk>
Nov 13 17:33:18 user nova-compute[75100]:     <controller type='usb' index='0' model='none'>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='usb'/>
Nov 13 17:33:18 user nova-compute[75100]:     </controller>
Nov 13 17:33:18 user nova-compute[75100]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='pci.0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </controller>
Nov 13 17:33:18 user nova-compute[75100]:     <controller type='ide' index='0'>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='ide'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 17:33:18 user nova-compute[75100]:     </controller>
Nov 13 17:33:18 user nova-compute[75100]:     <interface type='ethernet'>
Nov 13 17:33:18 user nova-compute[75100]:       <mac address='fa:16:3e:3b:85:9d'/>
Nov 13 17:33:18 user nova-compute[75100]:       <target dev='tap06242103-07'/>
Nov 13 17:33:18 user nova-compute[75100]:       <model type='virtio'/>
Nov 13 17:33:18 user nova-compute[75100]:       <mtu size='1442'/>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='net0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </interface>
Nov 13 17:33:18 user nova-compute[75100]:     <serial type='pty'>
Nov 13 17:33:18 user nova-compute[75100]:       <source path='/dev/pts/5'/>
Nov 13 17:33:18 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/console.log' append='off'/>
Nov 13 17:33:18 user nova-compute[75100]:       <target type='isa-serial' port='0'>
Nov 13 17:33:18 user nova-compute[75100]:         <model name='isa-serial'/>
Nov 13 17:33:18 user nova-compute[75100]:       </target>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='serial0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </serial>
Nov 13 17:33:18 user nova-compute[75100]:     <console type='pty' tty='/dev/pts/5'>
Nov 13 17:33:18 user nova-compute[75100]:       <source path='/dev/pts/5'/>
Nov 13 17:33:18 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/console.log' append='off'/>
Nov 13 17:33:18 user nova-compute[75100]:       <target type='serial' port='0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='serial0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </console>
Nov 13 17:33:18 user nova-compute[75100]:     <input type='mouse' bus='ps2'>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='input0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </input>
Nov 13 17:33:18 user nova-compute[75100]:     <input type='keyboard' bus='ps2'>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='input1'/>
Nov 13 17:33:18 user nova-compute[75100]:     </input>
Nov 13 17:33:18 user nova-compute[75100]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 13 17:33:18 user nova-compute[75100]:       <listen type='address' address='0.0.0.0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </graphics>
Nov 13 17:33:18 user nova-compute[75100]:     <audio id='1' type='none'/>
Nov 13 17:33:18 user nova-compute[75100]:     <video>
Nov 13 17:33:18 user nova-compute[75100]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='video0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </video>
Nov 13 17:33:18 user nova-compute[75100]:     <memballoon model='virtio'>
Nov 13 17:33:18 user nova-compute[75100]:       <stats period='10'/>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='balloon0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </memballoon>
Nov 13 17:33:18 user nova-compute[75100]:     <rng model='virtio'>
Nov 13 17:33:18 user nova-compute[75100]:       <backend model='random'>/dev/urandom</backend>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='rng0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </rng>
Nov 13 17:33:18 user nova-compute[75100]:   </devices>
Nov 13 17:33:18 user nova-compute[75100]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 17:33:18 user nova-compute[75100]:     <label>libvirt-bcb48f07-30a1-48a1-b739-49bf2513c013</label>
Nov 13 17:33:18 user nova-compute[75100]:     <imagelabel>libvirt-bcb48f07-30a1-48a1-b739-49bf2513c013</imagelabel>
Nov 13 17:33:18 user nova-compute[75100]:   </seclabel>
Nov 13 17:33:18 user nova-compute[75100]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 17:33:18 user nova-compute[75100]:     <label>+64055:+108</label>
Nov 13 17:33:18 user nova-compute[75100]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 17:33:18 user nova-compute[75100]:   </seclabel>
Nov 13 17:33:18 user nova-compute[75100]: </domain>
Nov 13 17:33:18 user nova-compute[75100]:  {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f9:d0:54"/><model type="virtio"/><mtu size="1442"/><target dev="tapfea81257-da"/></interface> {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f9:d0:54"/><model type="virtio"/><mtu size="1442"/><target dev="tapfea81257-da"/></interface>not found in domain: <domain type='kvm' id='39'>
Nov 13 17:33:18 user nova-compute[75100]:   <name>instance-0000001c</name>
Nov 13 17:33:18 user nova-compute[75100]:   <uuid>bcb48f07-30a1-48a1-b739-49bf2513c013</uuid>
Nov 13 17:33:18 user nova-compute[75100]:   <metadata>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:33:18 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1119793217</nova:name>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:creationTime>2023-11-13 17:33:16</nova:creationTime>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 13 17:33:18 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 13 17:33:18 user nova-compute[75100]:   </nova:flavor>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:owner>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:user uuid="b10372a7ca7845d8970b4f957afd249d">tempest-TaggedAttachmentsTest-1699715910-project-member</nova:user>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:project uuid="48b8e980410348b48bf04fc382c4e60c">tempest-TaggedAttachmentsTest-1699715910</nova:project>
Nov 13 17:33:18 user nova-compute[75100]:   </nova:owner>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:ports>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:port uuid="06242103-0705-434a-8b09-54be30f73283">
Nov 13 17:33:18 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 17:33:18 user nova-compute[75100]:     </nova:port>
Nov 13 17:33:18 user nova-compute[75100]:   </nova:ports>
Nov 13 17:33:18 user nova-compute[75100]: </nova:instance>
Nov 13 17:33:18 user nova-compute[75100]:   </metadata>
Nov 13 17:33:18 user nova-compute[75100]:   <memory unit='KiB'>524288</memory>
Nov 13 17:33:18 user nova-compute[75100]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 17:33:18 user nova-compute[75100]:   <vcpu placement='static'>1</vcpu>
Nov 13 17:33:18 user nova-compute[75100]:   <resource>
Nov 13 17:33:18 user nova-compute[75100]:     <partition>/machine</partition>
Nov 13 17:33:18 user nova-compute[75100]:   </resource>
Nov 13 17:33:18 user nova-compute[75100]:   <sysinfo type='smbios'>
Nov 13 17:33:18 user nova-compute[75100]:     <system>
Nov 13 17:33:18 user nova-compute[75100]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 17:33:18 user nova-compute[75100]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 17:33:18 user nova-compute[75100]:       <entry name='version'>0.0.0</entry>
Nov 13 17:33:18 user nova-compute[75100]:       <entry name='serial'>bcb48f07-30a1-48a1-b739-49bf2513c013</entry>
Nov 13 17:33:18 user nova-compute[75100]:       <entry name='uuid'>bcb48f07-30a1-48a1-b739-49bf2513c013</entry>
Nov 13 17:33:18 user nova-compute[75100]:       <entry name='family'>Virtual Machine</entry>
Nov 13 17:33:18 user nova-compute[75100]:     </system>
Nov 13 17:33:18 user nova-compute[75100]:   </sysinfo>
Nov 13 17:33:18 user nova-compute[75100]:   <os>
Nov 13 17:33:18 user nova-compute[75100]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 17:33:18 user nova-compute[75100]:     <boot dev='hd'/>
Nov 13 17:33:18 user nova-compute[75100]:     <smbios mode='sysinfo'/>
Nov 13 17:33:18 user nova-compute[75100]:   </os>
Nov 13 17:33:18 user nova-compute[75100]:   <features>
Nov 13 17:33:18 user nova-compute[75100]:     <acpi/>
Nov 13 17:33:18 user nova-compute[75100]:     <apic/>
Nov 13 17:33:18 user nova-compute[75100]:     <vmcoreinfo state='on'/>
Nov 13 17:33:18 user nova-compute[75100]:   </features>
Nov 13 17:33:18 user nova-compute[75100]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 17:33:18 user nova-compute[75100]:     <model fallback='forbid'>Nehalem</model>
Nov 13 17:33:18 user nova-compute[75100]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 17:33:18 user nova-compute[75100]:     <feature policy='require' name='vme'/>
Nov 13 17:33:18 user nova-compute[75100]:     <feature policy='require' name='x2apic'/>
Nov 13 17:33:18 user nova-compute[75100]:     <feature policy='require' name='hypervisor'/>
Nov 13 17:33:18 user nova-compute[75100]:   </cpu>
Nov 13 17:33:18 user nova-compute[75100]:   <clock offset='utc'>
Nov 13 17:33:18 user nova-compute[75100]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 17:33:18 user nova-compute[75100]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 17:33:18 user nova-compute[75100]:     <timer name='hpet' present='no'/>
Nov 13 17:33:18 user nova-compute[75100]:   </clock>
Nov 13 17:33:18 user nova-compute[75100]:   <on_poweroff>destroy</on_poweroff>
Nov 13 17:33:18 user nova-compute[75100]:   <on_reboot>restart</on_reboot>
Nov 13 17:33:18 user nova-compute[75100]:   <on_crash>destroy</on_crash>
Nov 13 17:33:18 user nova-compute[75100]:   <devices>
Nov 13 17:33:18 user nova-compute[75100]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 17:33:18 user nova-compute[75100]:     <disk type='file' device='disk'>
Nov 13 17:33:18 user nova-compute[75100]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 17:33:18 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk' index='2'/>
Nov 13 17:33:18 user nova-compute[75100]:       <backingStore type='file' index='3'>
Nov 13 17:33:18 user nova-compute[75100]:         <format type='raw'/>
Nov 13 17:33:18 user nova-compute[75100]:         <source file='/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9'/>
Nov 13 17:33:18 user nova-compute[75100]:         <backingStore/>
Nov 13 17:33:18 user nova-compute[75100]:       </backingStore>
Nov 13 17:33:18 user nova-compute[75100]:       <target dev='vda' bus='virtio'/>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='virtio-disk0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </disk>
Nov 13 17:33:18 user nova-compute[75100]:     <disk type='file' device='cdrom'>
Nov 13 17:33:18 user nova-compute[75100]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 17:33:18 user nova-compute[75100]:       <source file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk.config' index='1'/>
Nov 13 17:33:18 user nova-compute[75100]:       <backingStore/>
Nov 13 17:33:18 user nova-compute[75100]:       <target dev='hda' bus='ide'/>
Nov 13 17:33:18 user nova-compute[75100]:       <readonly/>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='ide0-0-0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </disk>
Nov 13 17:33:18 user nova-compute[75100]:     <controller type='usb' index='0' model='none'>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='usb'/>
Nov 13 17:33:18 user nova-compute[75100]:     </controller>
Nov 13 17:33:18 user nova-compute[75100]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='pci.0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </controller>
Nov 13 17:33:18 user nova-compute[75100]:     <controller type='ide' index='0'>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='ide'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 17:33:18 user nova-compute[75100]:     </controller>
Nov 13 17:33:18 user nova-compute[75100]:     <interface type='ethernet'>
Nov 13 17:33:18 user nova-compute[75100]:       <mac address='fa:16:3e:3b:85:9d'/>
Nov 13 17:33:18 user nova-compute[75100]:       <target dev='tap06242103-07'/>
Nov 13 17:33:18 user nova-compute[75100]:       <model type='virtio'/>
Nov 13 17:33:18 user nova-compute[75100]:       <mtu size='1442'/>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='net0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </interface>
Nov 13 17:33:18 user nova-compute[75100]:     <serial type='pty'>
Nov 13 17:33:18 user nova-compute[75100]:       <source path='/dev/pts/5'/>
Nov 13 17:33:18 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/console.log' append='off'/>
Nov 13 17:33:18 user nova-compute[75100]:       <target type='isa-serial' port='0'>
Nov 13 17:33:18 user nova-compute[75100]:         <model name='isa-serial'/>
Nov 13 17:33:18 user nova-compute[75100]:       </target>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='serial0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </serial>
Nov 13 17:33:18 user nova-compute[75100]:     <console type='pty' tty='/dev/pts/5'>
Nov 13 17:33:18 user nova-compute[75100]:       <source path='/dev/pts/5'/>
Nov 13 17:33:18 user nova-compute[75100]:       <log file='/opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/console.log' append='off'/>
Nov 13 17:33:18 user nova-compute[75100]:       <target type='serial' port='0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='serial0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </console>
Nov 13 17:33:18 user nova-compute[75100]:     <input type='mouse' bus='ps2'>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='input0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </input>
Nov 13 17:33:18 user nova-compute[75100]:     <input type='keyboard' bus='ps2'>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='input1'/>
Nov 13 17:33:18 user nova-compute[75100]:     </input>
Nov 13 17:33:18 user nova-compute[75100]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 13 17:33:18 user nova-compute[75100]:       <listen type='address' address='0.0.0.0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </graphics>
Nov 13 17:33:18 user nova-compute[75100]:     <audio id='1' type='none'/>
Nov 13 17:33:18 user nova-compute[75100]:     <video>
Nov 13 17:33:18 user nova-compute[75100]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='video0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </video>
Nov 13 17:33:18 user nova-compute[75100]:     <memballoon model='virtio'>
Nov 13 17:33:18 user nova-compute[75100]:       <stats period='10'/>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='balloon0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </memballoon>
Nov 13 17:33:18 user nova-compute[75100]:     <rng model='virtio'>
Nov 13 17:33:18 user nova-compute[75100]:       <backend model='random'>/dev/urandom</backend>
Nov 13 17:33:18 user nova-compute[75100]:       <alias name='rng0'/>
Nov 13 17:33:18 user nova-compute[75100]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 17:33:18 user nova-compute[75100]:     </rng>
Nov 13 17:33:18 user nova-compute[75100]:   </devices>
Nov 13 17:33:18 user nova-compute[75100]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 17:33:18 user nova-compute[75100]:     <label>libvirt-bcb48f07-30a1-48a1-b739-49bf2513c013</label>
Nov 13 17:33:18 user nova-compute[75100]:     <imagelabel>libvirt-bcb48f07-30a1-48a1-b739-49bf2513c013</imagelabel>
Nov 13 17:33:18 user nova-compute[75100]:   </seclabel>
Nov 13 17:33:18 user nova-compute[75100]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 17:33:18 user nova-compute[75100]:     <label>+64055:+108</label>
Nov 13 17:33:18 user nova-compute[75100]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 17:33:18 user nova-compute[75100]:   </seclabel>
Nov 13 17:33:18 user nova-compute[75100]: </domain>
Nov 13 17:33:18 user nova-compute[75100]:  {{(pid=75100) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 17:33:18 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Detaching interface fa:16:3e:f9:d0:54 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapfea81257-da' not found.
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1119793217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1119793217',id=28,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvx8JQIBkL21nN5cuKYIjTT8NnZAWSZMP2QkZAc6pbLZaJgU2fYiAQEBg0Xgdwf3KsbdPq5Sf/a+dIZy7MOu0OovA6J7QJWFX9Lec9YN4YQPY7+toKNUPqHUKmWixmRqw==',key_name='tempest-keypair-1552872187',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48b8e980410348b48bf04fc382c4e60c',ramdisk_id='',reservation_id='r-n03514yb',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1699715910',owner_user_name='tempest-TaggedAttachmentsTest-1699715910-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b10372a7ca7845d8970b4f957afd249d',uuid=bcb48f07-30a1-48a1-b739-49bf2513c013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.network.os_vif_util [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] Converting VIF {"id": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "address": "fa:16:3e:f9:d0:54", "network": {"id": "165302f5-40f8-42db-8278-b8c3710f0958", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1783170079", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfea81257-da", "ovs_interfaceid": "fea81257-dac0-4e3c-8b1e-ea23b00449a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.network.os_vif_util [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d0:54,bridge_name='br-int',has_traffic_filtering=True,id=fea81257-dac0-4e3c-8b1e-ea23b00449a1,network=Network(165302f5-40f8-42db-8278-b8c3710f0958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea81257-da') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG os_vif [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d0:54,bridge_name='br-int',has_traffic_filtering=True,id=fea81257-dac0-4e3c-8b1e-ea23b00449a1,network=Network(165302f5-40f8-42db-8278-b8c3710f0958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea81257-da') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfea81257-da, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:33:18 user nova-compute[75100]: INFO os_vif [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:d0:54,bridge_name='br-int',has_traffic_filtering=True,id=fea81257-dac0-4e3c-8b1e-ea23b00449a1,network=Network(165302f5-40f8-42db-8278-b8c3710f0958),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfea81257-da')
Nov 13 17:33:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [req-96ffcebe-08b8-4ba1-8acf-456e0de66e75 req-f75d7f09-3d13-457d-890e-08421bb3ac78 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:33:18 user nova-compute[75100]:   <nova:package version="0.0.0"/>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:name>tempest-device-tagging-server-1119793217</nova:name>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:creationTime>2023-11-13 17:33:18</nova:creationTime>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:flavor name="m1.tiny">
Nov 13 17:33:18 user nova-compute[75100]:     <nova:memory>512</nova:memory>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:disk>1</nova:disk>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:swap>0</nova:swap>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:vcpus>1</nova:vcpus>
Nov 13 17:33:18 user nova-compute[75100]:   </nova:flavor>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:owner>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:user uuid="b10372a7ca7845d8970b4f957afd249d">tempest-TaggedAttachmentsTest-1699715910-project-member</nova:user>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:project uuid="48b8e980410348b48bf04fc382c4e60c">tempest-TaggedAttachmentsTest-1699715910</nova:project>
Nov 13 17:33:18 user nova-compute[75100]:   </nova:owner>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:33:18 user nova-compute[75100]:   <nova:ports>
Nov 13 17:33:18 user nova-compute[75100]:     <nova:port uuid="06242103-0705-434a-8b09-54be30f73283">
Nov 13 17:33:18 user nova-compute[75100]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 17:33:18 user nova-compute[75100]:     </nova:port>
Nov 13 17:33:18 user nova-compute[75100]:   </nova:ports>
Nov 13 17:33:18 user nova-compute[75100]: </nova:instance>
Nov 13 17:33:18 user nova-compute[75100]:  {{(pid=75100) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMKHICND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:33:19 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:33:19 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:33:19 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[614071a5-7950-4a3e-8b78-47882b574f26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:33:19 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a006f7f-8dde-42df-81b3-c24c80b99c24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2] added
Nov 13 17:33:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6521da-94f2-4a28-9261-7f23836b3ac0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90d2f6d-bcaa-4f01-8403-5750593c448f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMKHICND {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMKHICND" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f876ad-f5c1-41dd-b2a9-1132f9b078af]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wMKHICND'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e69b51-a28d-41a4-8421-49be5d9c6767]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc6ac91-25a6-46bf-bf10-62f7d9f7c006]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee398b1d-da82-45a9-97b0-eb8777a831f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260]
Nov 13 17:33:19 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260] successful.
Nov 13 17:33:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7354a854-3868-4010-95eb-f1f3918bb98f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52ac7b2-983c-4966-b1aa-a9db13f706a2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:19 user nova-compute[75100]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:19 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.432s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] HCTL ('39', '-', '-', 0) found on session 39 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2889fa74-74fd-4f79-9994-d7ed091e0c05]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Searching for a device in session 39 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:33:19 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMKHICND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:33:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Creating image(s)
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Ensure instance console log exists: /opt/stack/data/nova/instances/6b7d6fb7-30cb-46bd-8ec9-11d60f160350/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Start _get_guest_xml network_info=[{"id": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "address": "fa:16:3e:38:31:d4", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a265285-9a", "ovs_interfaceid": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '7bd858fa-6854-4068-9169-f4f07e618eeb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oySDifEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6b7d6fb7-30cb-46bd-8ec9-11d60f160350', 'attached_at': '', 'detached_at': '', 'volume_id': '973314de-8205-4322-91eb-a9566496a56c', 'serial': '973314de-8205-4322-91eb-a9566496a56c'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:33:20 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:33:20 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oySDifEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:33:20 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.497s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] <== connect_volume: return (1500ms) {'type': 'block', 'scsi_wwn': '23336393565633666', 'path': '/dev/sdh'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336393565633666', 'path': '/dev/sdh'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.423s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:33:20 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:33:20 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.objects.instance [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'flavor' on Instance uuid a5f308a2-3b44-476e-85ab-15e1bf107968 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea0672d-a5f7-4045-a38d-8489ad1b1f49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:33:20 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:33:20 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:33:20 user nova-compute[75100]:   <source dev="/dev/sdh"/>
Nov 13 17:33:20 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:33:20 user nova-compute[75100]:   <serial>9deacb14-d81b-46e6-9701-ec9ce76ebab2</serial>
Nov 13 17:33:20 user nova-compute[75100]: </disk>
Nov 13 17:33:20 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e403d4-7d4b-4500-9215-ca338e2aacb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c] added
Nov 13 17:33:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab52831-0d9f-40ae-b197-6062867c5ea5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[185e60d2-a40b-4b13-a8fb-26d962582018]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oySDifEA {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oySDifEA" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8349fe-c38e-4236-91a5-cdf76bf4c9a2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oySDifEA'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f923d4-bdc0-4a5f-a37e-818b35a454eb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee0c14b-14ad-4028-a00e-aeb6f49bd118]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7f99d4-2b25-4e45-af03-469703f25a1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c, portal: 172.16.0.220,3260]
Nov 13 17:33:20 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c, portal: 172.16.0.220,3260] successful.
Nov 13 17:33:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d5e09f-96f5-4f63-bd4c-ba69f7bfdd58]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1bfe28-3560-463d-9cc4-c0333e100cff]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:33:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:20 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:33:20 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] HCTL ('40', '-', '-', 0) found on session 40 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[93227fbb-37b5-4c5c-8e3b-612a84287ce1]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Searching for a device in session 40 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:33:20 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oySDifEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] No VIF found with MAC fa:16:3e:e4:03:2a, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3323b2b1-8fa3-4332-bbd4-502c6e78fe33 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.798s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== connect_volume: return (1803ms) {'type': 'block', 'scsi_wwn': '23033383065393732', 'path': '/dev/sdi'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033383065393732', 'path': '/dev/sdi'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1840907896',display_name='tempest-TestVolumeBootPattern-server-1840907896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1840907896',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+NtN2Z5kT0TQJbfKGQsJyKiPak8bepWgNcLUPGujC+AXoGWK840LLNYNacMdPigyvVLHhv89mM2IBFpbgvf3ZqImVEZSa6YyJUnBkkWfhyP+tfJPZtUfdOTGbNpjZ7sA==',key_name='tempest-TestVolumeBootPattern-2052596683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-jefg57tu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:33:15Z,user_data=None,user_id='421484d1f180498fa5e078c084d70986',uuid=6b7d6fb7-30cb-46bd-8ec9-11d60f160350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "address": "fa:16:3e:38:31:d4", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a265285-9a", "ovs_interfaceid": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "address": "fa:16:3e:38:31:d4", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a265285-9a", "ovs_interfaceid": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:31:d4,bridge_name='br-int',has_traffic_filtering=True,id=5a265285-9a4e-46b3-bd04-3b3f3608aaba,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a265285-9a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG nova.objects.instance [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b7d6fb7-30cb-46bd-8ec9-11d60f160350 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:33:21 user nova-compute[75100]:   <uuid>6b7d6fb7-30cb-46bd-8ec9-11d60f160350</uuid>
Nov 13 17:33:21 user nova-compute[75100]:   <name>instance-00000021</name>
Nov 13 17:33:21 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:33:21 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:33:21 user nova-compute[75100]:   <metadata>
Nov 13 17:33:21 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:33:21 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:33:21 user nova-compute[75100]:       <nova:name>tempest-TestVolumeBootPattern-server-1840907896</nova:name>
Nov 13 17:33:21 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:33:20</nova:creationTime>
Nov 13 17:33:21 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:33:21 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:33:21 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:33:21 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:33:21 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:33:21 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:33:21 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:33:21 user nova-compute[75100]:       <nova:owner>
Nov 13 17:33:21 user nova-compute[75100]:         <nova:user uuid="421484d1f180498fa5e078c084d70986">tempest-TestVolumeBootPattern-1156978750-project-member</nova:user>
Nov 13 17:33:21 user nova-compute[75100]:         <nova:project uuid="20bd8fd1a36f49a08be3d97799e847a8">tempest-TestVolumeBootPattern-1156978750</nova:project>
Nov 13 17:33:21 user nova-compute[75100]:       </nova:owner>
Nov 13 17:33:21 user nova-compute[75100]:       <nova:ports>
Nov 13 17:33:21 user nova-compute[75100]:         <nova:port uuid="5a265285-9a4e-46b3-bd04-3b3f3608aaba">
Nov 13 17:33:21 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:33:21 user nova-compute[75100]:         </nova:port>
Nov 13 17:33:21 user nova-compute[75100]:       </nova:ports>
Nov 13 17:33:21 user nova-compute[75100]:     </nova:instance>
Nov 13 17:33:21 user nova-compute[75100]:   </metadata>
Nov 13 17:33:21 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:33:21 user nova-compute[75100]:     <system>
Nov 13 17:33:21 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:33:21 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:33:21 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:33:21 user nova-compute[75100]:       <entry name="serial">6b7d6fb7-30cb-46bd-8ec9-11d60f160350</entry>
Nov 13 17:33:21 user nova-compute[75100]:       <entry name="uuid">6b7d6fb7-30cb-46bd-8ec9-11d60f160350</entry>
Nov 13 17:33:21 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:33:21 user nova-compute[75100]:     </system>
Nov 13 17:33:21 user nova-compute[75100]:   </sysinfo>
Nov 13 17:33:21 user nova-compute[75100]:   <os>
Nov 13 17:33:21 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:33:21 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:33:21 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:33:21 user nova-compute[75100]:   </os>
Nov 13 17:33:21 user nova-compute[75100]:   <features>
Nov 13 17:33:21 user nova-compute[75100]:     <acpi/>
Nov 13 17:33:21 user nova-compute[75100]:     <apic/>
Nov 13 17:33:21 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:33:21 user nova-compute[75100]:   </features>
Nov 13 17:33:21 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:33:21 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:33:21 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:33:21 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:33:21 user nova-compute[75100]:   </clock>
Nov 13 17:33:21 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:33:21 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:33:21 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:33:21 user nova-compute[75100]:   </cpu>
Nov 13 17:33:21 user nova-compute[75100]:   <devices>
Nov 13 17:33:21 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:33:21 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:33:21 user nova-compute[75100]:       <source dev="/dev/sdi"/>
Nov 13 17:33:21 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:33:21 user nova-compute[75100]:       <serial>973314de-8205-4322-91eb-a9566496a56c</serial>
Nov 13 17:33:21 user nova-compute[75100]:     </disk>
Nov 13 17:33:21 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:33:21 user nova-compute[75100]:       <mac address="fa:16:3e:38:31:d4"/>
Nov 13 17:33:21 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:33:21 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:33:21 user nova-compute[75100]:       <target dev="tap5a265285-9a"/>
Nov 13 17:33:21 user nova-compute[75100]:     </interface>
Nov 13 17:33:21 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:33:21 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/6b7d6fb7-30cb-46bd-8ec9-11d60f160350/console.log" append="off"/>
Nov 13 17:33:21 user nova-compute[75100]:     </serial>
Nov 13 17:33:21 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:33:21 user nova-compute[75100]:     <video>
Nov 13 17:33:21 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:33:21 user nova-compute[75100]:     </video>
Nov 13 17:33:21 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:33:21 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:33:21 user nova-compute[75100]:     </rng>
Nov 13 17:33:21 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:33:21 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:33:21 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:33:21 user nova-compute[75100]:     </memballoon>
Nov 13 17:33:21 user nova-compute[75100]:   </devices>
Nov 13 17:33:21 user nova-compute[75100]: </domain>
Nov 13 17:33:21 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1840907896',display_name='tempest-TestVolumeBootPattern-server-1840907896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1840907896',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+NtN2Z5kT0TQJbfKGQsJyKiPak8bepWgNcLUPGujC+AXoGWK840LLNYNacMdPigyvVLHhv89mM2IBFpbgvf3ZqImVEZSa6YyJUnBkkWfhyP+tfJPZtUfdOTGbNpjZ7sA==',key_name='tempest-TestVolumeBootPattern-2052596683',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-jefg57tu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:33:15Z,user_data=None,user_id='421484d1f180498fa5e078c084d70986',uuid=6b7d6fb7-30cb-46bd-8ec9-11d60f160350,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "address": "fa:16:3e:38:31:d4", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a265285-9a", "ovs_interfaceid": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "address": "fa:16:3e:38:31:d4", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a265285-9a", "ovs_interfaceid": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:31:d4,bridge_name='br-int',has_traffic_filtering=True,id=5a265285-9a4e-46b3-bd04-3b3f3608aaba,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a265285-9a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG os_vif [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:31:d4,bridge_name='br-int',has_traffic_filtering=True,id=5a265285-9a4e-46b3-bd04-3b3f3608aaba,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a265285-9a') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2edfd92d-035f-5d1d-9bd9-d697999c18fb', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a265285-9a, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a265285-9a, col_values=(('qos', UUID('e3afe2f3-209b-423c-b073-0e91a2443ca1')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a265285-9a, col_values=(('external_ids', {'iface-id': '5a265285-9a4e-46b3-bd04-3b3f3608aaba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:31:d4', 'vm-uuid': '6b7d6fb7-30cb-46bd-8ec9-11d60f160350'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:33:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:21 user nova-compute[75100]: INFO os_vif [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:31:d4,bridge_name='br-int',has_traffic_filtering=True,id=5a265285-9a4e-46b3-bd04-3b3f3608aaba,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a265285-9a')
Nov 13 17:33:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:33:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] No VIF found with MAC fa:16:3e:38:31:d4, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:33:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-26a71655-7864-434b-b17e-c3240906df30 req-b148b49c-e874-49ee-bf26-d876b6ee768f service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Received event network-vif-plugged-5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-26a71655-7864-434b-b17e-c3240906df30 req-b148b49c-e874-49ee-bf26-d876b6ee768f service nova] Acquiring lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-26a71655-7864-434b-b17e-c3240906df30 req-b148b49c-e874-49ee-bf26-d876b6ee768f service nova] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-26a71655-7864-434b-b17e-c3240906df30 req-b148b49c-e874-49ee-bf26-d876b6ee768f service nova] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-26a71655-7864-434b-b17e-c3240906df30 req-b148b49c-e874-49ee-bf26-d876b6ee768f service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] No waiting events found dispatching network-vif-plugged-5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:23 user nova-compute[75100]: WARNING nova.compute.manager [req-26a71655-7864-434b-b17e-c3240906df30 req-b148b49c-e874-49ee-bf26-d876b6ee768f service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Received unexpected event network-vif-plugged-5a265285-9a4e-46b3-bd04-3b3f3608aaba for instance with vm_state building and task_state spawning.
Nov 13 17:33:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:33:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Instance spawned successfully.
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-04780d0c-9295-4d26-8899-76cd7acd8c87 req-3a9d5c6f-fdca-4a22-82ce-167d2068bb54 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-changed-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-04780d0c-9295-4d26-8899-76cd7acd8c87 req-3a9d5c6f-fdca-4a22-82ce-167d2068bb54 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Refreshing instance network info cache due to event network-changed-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-04780d0c-9295-4d26-8899-76cd7acd8c87 req-3a9d5c6f-fdca-4a22-82ce-167d2068bb54 service nova] Acquiring lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-04780d0c-9295-4d26-8899-76cd7acd8c87 req-3a9d5c6f-fdca-4a22-82ce-167d2068bb54 service nova] Acquired lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-04780d0c-9295-4d26-8899-76cd7acd8c87 req-3a9d5c6f-fdca-4a22-82ce-167d2068bb54 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Refreshing network info cache for port 3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:33:25 user nova-compute[75100]: INFO nova.compute.manager [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-69fe59a2-e243-4ebe-a2f0-947829497efa req-7e30ea67-515f-429c-932a-3cb109272f63 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Received event network-vif-plugged-5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-69fe59a2-e243-4ebe-a2f0-947829497efa req-7e30ea67-515f-429c-932a-3cb109272f63 service nova] Acquiring lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-69fe59a2-e243-4ebe-a2f0-947829497efa req-7e30ea67-515f-429c-932a-3cb109272f63 service nova] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-69fe59a2-e243-4ebe-a2f0-947829497efa req-7e30ea67-515f-429c-932a-3cb109272f63 service nova] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-69fe59a2-e243-4ebe-a2f0-947829497efa req-7e30ea67-515f-429c-932a-3cb109272f63 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] No waiting events found dispatching network-vif-plugged-5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:25 user nova-compute[75100]: WARNING nova.compute.manager [req-69fe59a2-e243-4ebe-a2f0-947829497efa req-7e30ea67-515f-429c-932a-3cb109272f63 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Received unexpected event network-vif-plugged-5a265285-9a4e-46b3-bd04-3b3f3608aaba for instance with vm_state building and task_state spawning.
Nov 13 17:33:25 user nova-compute[75100]: INFO nova.compute.manager [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Took 11.48 seconds to build instance.
Nov 13 17:33:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-53541525-f8a6-4fdb-9a2e-663ca0e291fa tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.574s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:26 user nova-compute[75100]: DEBUG nova.network.neutron [req-04780d0c-9295-4d26-8899-76cd7acd8c87 req-3a9d5c6f-fdca-4a22-82ce-167d2068bb54 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updated VIF entry in instance network info cache for port 3f5b2945-ec9f-48e7-ada2-3c0cce2f8271. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:33:26 user nova-compute[75100]: DEBUG nova.network.neutron [req-04780d0c-9295-4d26-8899-76cd7acd8c87 req-3a9d5c6f-fdca-4a22-82ce-167d2068bb54 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updating instance_info_cache with network_info: [{"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-04780d0c-9295-4d26-8899-76cd7acd8c87 req-3a9d5c6f-fdca-4a22-82ce-167d2068bb54 service nova] Releasing lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:33:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:33:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:33:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-b15ef288-b826-466e-92be-2bb6dd93b0c5 req-ea067751-cba3-4446-bbc9-aba8cc39d453 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-changed-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-b15ef288-b826-466e-92be-2bb6dd93b0c5 req-ea067751-cba3-4446-bbc9-aba8cc39d453 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Refreshing instance network info cache due to event network-changed-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:33:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b15ef288-b826-466e-92be-2bb6dd93b0c5 req-ea067751-cba3-4446-bbc9-aba8cc39d453 service nova] Acquiring lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:33:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b15ef288-b826-466e-92be-2bb6dd93b0c5 req-ea067751-cba3-4446-bbc9-aba8cc39d453 service nova] Acquired lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:33:27 user nova-compute[75100]: DEBUG nova.network.neutron [req-b15ef288-b826-466e-92be-2bb6dd93b0c5 req-ea067751-cba3-4446-bbc9-aba8cc39d453 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Refreshing network info cache for port 3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:33:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-b15ef288-b826-466e-92be-2bb6dd93b0c5 req-ea067751-cba3-4446-bbc9-aba8cc39d453 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updated VIF entry in instance network info cache for port 3f5b2945-ec9f-48e7-ada2-3c0cce2f8271. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:33:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-b15ef288-b826-466e-92be-2bb6dd93b0c5 req-ea067751-cba3-4446-bbc9-aba8cc39d453 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updating instance_info_cache with network_info: [{"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b15ef288-b826-466e-92be-2bb6dd93b0c5 req-ea067751-cba3-4446-bbc9-aba8cc39d453 service nova] Releasing lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:33:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:33:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:28 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:33:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:30 user nova-compute[75100]: INFO nova.compute.manager [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Rebooting instance
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquired lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updating instance_info_cache with network_info: [{"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Releasing lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-bf5d3a15-2d8d-42fb-bbc4-910fb5743222 req-0d29cd31-0190-440b-93ad-78de89d130e1 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-vif-unplugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bf5d3a15-2d8d-42fb-bbc4-910fb5743222 req-0d29cd31-0190-440b-93ad-78de89d130e1 service nova] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bf5d3a15-2d8d-42fb-bbc4-910fb5743222 req-0d29cd31-0190-440b-93ad-78de89d130e1 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bf5d3a15-2d8d-42fb-bbc4-910fb5743222 req-0d29cd31-0190-440b-93ad-78de89d130e1 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-bf5d3a15-2d8d-42fb-bbc4-910fb5743222 req-0d29cd31-0190-440b-93ad-78de89d130e1 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] No waiting events found dispatching network-vif-unplugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:31 user nova-compute[75100]: WARNING nova.compute.manager [req-bf5d3a15-2d8d-42fb-bbc4-910fb5743222 req-0d29cd31-0190-440b-93ad-78de89d130e1 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received unexpected event network-vif-unplugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 for instance with vm_state active and task_state reboot_started_hard.
Nov 13 17:33:31 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Instance destroyed successfully.
Nov 13 17:33:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'resources' on Instance uuid a5f308a2-3b44-476e-85ab-15e1bf107968 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1606415269',display_name='tempest-TestMinimumBasicScenario-server-1606415269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1606415269',id=31,image_ref='f54422c8-8a7d-4261-92b2-7a48a86048b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbFqeEjBCfPtchoBTJKqBMlcdgUsNVL+XmYOfHVgKSjpw6C8LgkXx5dtm92oBIN3q6lU1BKohKSabIcLqYDIWoqeuTkgxt+/aS5wfehrXw5XF1uomKZNkQcH7ewifI6Rw==',key_name='tempest-TestMinimumBasicScenario-754296732',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dca12c426d0c495b80b77b8ae26be4eb',ramdisk_id='',reservation_id='r-7oh5r93s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f54422c8-8a7d-4261-92b2-7a48a86048b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1769966982',owner_user_name='tempest-TestMinimumBasicScenario-1769966982-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:33:31Z,user_data=None,user_id='2ba71ec67c664e94a71cc9f9107303a5',uuid=a5f308a2-3b44-476e-85ab-15e1bf107968,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converting VIF {"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG os_vif [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f5b2945-ec, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad30f594-1c34-45a8-91b4-e1bc570fa7b4) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:31 user nova-compute[75100]: INFO os_vif [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec')
Nov 13 17:33:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMKHICND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:33:31 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:33:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7fde3c-7c7d-460d-ac95-22c418bc011d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:33:31 user nova-compute[75100]: No targets found.
Nov 13 17:33:31 user nova-compute[75100]: iSNS:
Nov 13 17:33:31 user nova-compute[75100]: No targets found.
Nov 13 17:33:31 user nova-compute[75100]: STATIC:
Nov 13 17:33:31 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:33:31 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:31 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:31 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c
Nov 13 17:33:31 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:31 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:31 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22
Nov 13 17:33:31 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:31 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:31 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7
Nov 13 17:33:31 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:31 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:31 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da
Nov 13 17:33:31 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:31 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:31 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:33:31 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:31 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:31 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2
Nov 13 17:33:31 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:31 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:31 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:33:31 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:31 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:31 user nova-compute[75100]: FIRMWARE:
Nov 13 17:33:31 user nova-compute[75100]: No targets found.
Nov 13 17:33:31 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:33:31 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:33:31 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c73082-03b8-493b-bad0-2310ba138681]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4065136-c894-4c74-b91c-b8b660d4f635]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:33:31 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:31 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:33:31 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38f5f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2'): ({'sdh'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Removing single pathed devices sdh {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d43651-6641-4944-8c80-e63c4d8eb614]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77cd883-8315-47b7-b446-b44474b71e0f]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Flushing IO for device /dev/sdh {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6564939b-f080-4a26-a2e1-2eecb246ba59]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[38053342-bf42-4188-b76a-1b0c16b74010]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] SCSI volumes sdh have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.rescue --force-share --output=json" returned: 0 in 0.252s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[50af1d51-071e-49b0-bf91-04ec7cdbd30e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c94c12-2904-4693-b158-2a742544eb09]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260]
Nov 13 17:33:32 user nova-compute[75100]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260] successful.
Nov 13 17:33:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.054s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b5edb7-fec5-4e51-b83e-badac5301469]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.508s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] <== disconnect_volume: return (512ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Start _get_guest_xml network_info=[{"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f54422c8-8a7d-4261-92b2-7a48a86048b0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'f54422c8-8a7d-4261-92b2-7a48a86048b0'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'e19317a6-6e09-4b14-a149-aa329ea40335', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMKHICND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'a5f308a2-3b44-476e-85ab-15e1bf107968', 'attached_at': '', 'detached_at': '', 'volume_id': '9deacb14-d81b-46e6-9701-ec9ce76ebab2', 'serial': '9deacb14-d81b-46e6-9701-ec9ce76ebab2'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:32 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:33:32 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f54422c8-8a7d-4261-92b2-7a48a86048b0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.objects.instance [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'vcpu_model' on Instance uuid a5f308a2-3b44-476e-85ab-15e1bf107968 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.objects.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Object Instance<a5f308a2-3b44-476e-85ab-15e1bf107968> lazy-loaded attributes: resources,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMKHICND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:33:32 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:33:32 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:33:32 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:33:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8651bf-01e0-42ee-84be-c969f8b062f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:33:32 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f91a3cc-170c-4b70-b727-ad8dd7187fe0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2] added
Nov 13 17:33:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdabc7c5-1c8b-4230-8a09-4a77d312d775]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f6df56-4cc0-407c-9afe-f145f1a17c2a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMKHICND {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wMKHICND" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[55006e0d-0601-47f4-bbe7-5846ee6156e3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wMKHICND'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc09585-a513-48c0-88f9-227a5c913057]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dae83fc-05a0-4a69-a1dc-e44ff6e4cae0]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:33:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:33:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e572327e-d692-4896-8537-a78553f492b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260]
Nov 13 17:33:32 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260] successful.
Nov 13 17:33:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d846fa-305c-4575-9c23-df88f5840e5e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b251beb-c533-49e1-9c89-2f7d9f73f665]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:33:32 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] HCTL ('39', '-', '-', 0) found on session 41 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6911303-78fa-4b53-b3da-6f4a8ceaffcd]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Searching for a device in session 41 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMKHICND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:33:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Error from libvirt while getting description of instance-0000001f: [Error Code 42] Domain not found: no domain with matching uuid 'a5f308a2-3b44-476e-85ab-15e1bf107968' (instance-0000001f): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a5f308a2-3b44-476e-85ab-15e1bf107968' (instance-0000001f)
Nov 13 17:33:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:33:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=6961MB free_disk=24.903465270996094GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Applying migration context for instance 73c5d863-7cae-481f-b8ea-dfc217514658 as it has an incoming, in-progress migration 35421aba-e45e-42f4-a2a1-b50a2e57287f. Migration status is finished {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 17:33:33 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Updating resource usage from migration 35421aba-e45e-42f4-a2a1-b50a2e57287f
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d2c4575b-ef8d-4a9d-9650-459366b7227e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance d30816f4-82ec-43b9-bd47-f34190e5c82f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance bcb48f07-30a1-48a1-b739-49bf2513c013 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance a5f308a2-3b44-476e-85ab-15e1bf107968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Migration 35421aba-e45e-42f4-a2a1-b50a2e57287f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 73c5d863-7cae-481f-b8ea-dfc217514658 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6b7d6fb7-30cb-46bd-8ec9-11d60f160350 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=10240MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-6aa5d07e-7e0e-4eb5-939c-7831e249db34 req-d8dc69c0-564d-44a4-a612-2cd98445b9c2 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6aa5d07e-7e0e-4eb5-939c-7831e249db34 req-d8dc69c0-564d-44a4-a612-2cd98445b9c2 service nova] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6aa5d07e-7e0e-4eb5-939c-7831e249db34 req-d8dc69c0-564d-44a4-a612-2cd98445b9c2 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6aa5d07e-7e0e-4eb5-939c-7831e249db34 req-d8dc69c0-564d-44a4-a612-2cd98445b9c2 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-6aa5d07e-7e0e-4eb5-939c-7831e249db34 req-d8dc69c0-564d-44a4-a612-2cd98445b9c2 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] No waiting events found dispatching network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:33 user nova-compute[75100]: WARNING nova.compute.manager [req-6aa5d07e-7e0e-4eb5-939c-7831e249db34 req-d8dc69c0-564d-44a4-a612-2cd98445b9c2 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received unexpected event network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 for instance with vm_state active and task_state reboot_started_hard.
Nov 13 17:33:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23336393565633666', 'path': '/dev/sdh'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336393565633666', 'path': '/dev/sdh'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1606415269',display_name='tempest-TestMinimumBasicScenario-server-1606415269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1606415269',id=31,image_ref='f54422c8-8a7d-4261-92b2-7a48a86048b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbFqeEjBCfPtchoBTJKqBMlcdgUsNVL+XmYOfHVgKSjpw6C8LgkXx5dtm92oBIN3q6lU1BKohKSabIcLqYDIWoqeuTkgxt+/aS5wfehrXw5XF1uomKZNkQcH7ewifI6Rw==',key_name='tempest-TestMinimumBasicScenario-754296732',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dca12c426d0c495b80b77b8ae26be4eb',ramdisk_id='',reservation_id='r-7oh5r93s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f54422c8-8a7d-4261-92b2-7a48a86048b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1769966982',owner_user_name='tempest-TestMinimumBasicScenario-1769966982-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:33:31Z,user_data=None,user_id='2ba71ec67c664e94a71cc9f9107303a5',uuid=a5f308a2-3b44-476e-85ab-15e1bf107968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converting VIF {"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.objects.instance [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'pci_devices' on Instance uuid a5f308a2-3b44-476e-85ab-15e1bf107968 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.objects.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Object Instance<a5f308a2-3b44-476e-85ab-15e1bf107968> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:33:33 user nova-compute[75100]:   <uuid>a5f308a2-3b44-476e-85ab-15e1bf107968</uuid>
Nov 13 17:33:33 user nova-compute[75100]:   <name>instance-0000001f</name>
Nov 13 17:33:33 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:33:33 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:33:33 user nova-compute[75100]:   <metadata>
Nov 13 17:33:33 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:33:33 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:33:33 user nova-compute[75100]:       <nova:name>tempest-TestMinimumBasicScenario-server-1606415269</nova:name>
Nov 13 17:33:33 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:33:32</nova:creationTime>
Nov 13 17:33:33 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:33:33 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:33:33 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:33:33 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:33:33 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:33:33 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:33:33 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:33:33 user nova-compute[75100]:       <nova:owner>
Nov 13 17:33:33 user nova-compute[75100]:         <nova:user uuid="2ba71ec67c664e94a71cc9f9107303a5">tempest-TestMinimumBasicScenario-1769966982-project-member</nova:user>
Nov 13 17:33:33 user nova-compute[75100]:         <nova:project uuid="dca12c426d0c495b80b77b8ae26be4eb">tempest-TestMinimumBasicScenario-1769966982</nova:project>
Nov 13 17:33:33 user nova-compute[75100]:       </nova:owner>
Nov 13 17:33:33 user nova-compute[75100]:       <nova:root type="image" uuid="f54422c8-8a7d-4261-92b2-7a48a86048b0"/>
Nov 13 17:33:33 user nova-compute[75100]:       <nova:ports>
Nov 13 17:33:33 user nova-compute[75100]:         <nova:port uuid="3f5b2945-ec9f-48e7-ada2-3c0cce2f8271">
Nov 13 17:33:33 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:33:33 user nova-compute[75100]:         </nova:port>
Nov 13 17:33:33 user nova-compute[75100]:       </nova:ports>
Nov 13 17:33:33 user nova-compute[75100]:     </nova:instance>
Nov 13 17:33:33 user nova-compute[75100]:   </metadata>
Nov 13 17:33:33 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:33:33 user nova-compute[75100]:     <system>
Nov 13 17:33:33 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:33:33 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:33:33 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:33:33 user nova-compute[75100]:       <entry name="serial">a5f308a2-3b44-476e-85ab-15e1bf107968</entry>
Nov 13 17:33:33 user nova-compute[75100]:       <entry name="uuid">a5f308a2-3b44-476e-85ab-15e1bf107968</entry>
Nov 13 17:33:33 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:33:33 user nova-compute[75100]:     </system>
Nov 13 17:33:33 user nova-compute[75100]:   </sysinfo>
Nov 13 17:33:33 user nova-compute[75100]:   <os>
Nov 13 17:33:33 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:33:33 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:33:33 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:33:33 user nova-compute[75100]:   </os>
Nov 13 17:33:33 user nova-compute[75100]:   <features>
Nov 13 17:33:33 user nova-compute[75100]:     <acpi/>
Nov 13 17:33:33 user nova-compute[75100]:     <apic/>
Nov 13 17:33:33 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:33:33 user nova-compute[75100]:   </features>
Nov 13 17:33:33 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:33:33 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:33:33 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:33:33 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:33:33 user nova-compute[75100]:   </clock>
Nov 13 17:33:33 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:33:33 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:33:33 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:33:33 user nova-compute[75100]:   </cpu>
Nov 13 17:33:33 user nova-compute[75100]:   <devices>
Nov 13 17:33:33 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:33:33 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:33:33 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk"/>
Nov 13 17:33:33 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:33:33 user nova-compute[75100]:     </disk>
Nov 13 17:33:33 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:33:33 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:33:33 user nova-compute[75100]:       <source dev="/dev/sdh"/>
Nov 13 17:33:33 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:33:33 user nova-compute[75100]:       <serial>9deacb14-d81b-46e6-9701-ec9ce76ebab2</serial>
Nov 13 17:33:33 user nova-compute[75100]:     </disk>
Nov 13 17:33:33 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:33:33 user nova-compute[75100]:       <mac address="fa:16:3e:e4:03:2a"/>
Nov 13 17:33:33 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:33:33 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:33:33 user nova-compute[75100]:       <target dev="tap3f5b2945-ec"/>
Nov 13 17:33:33 user nova-compute[75100]:     </interface>
Nov 13 17:33:33 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:33:33 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/console.log" append="off"/>
Nov 13 17:33:33 user nova-compute[75100]:     </serial>
Nov 13 17:33:33 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:33:33 user nova-compute[75100]:     <video>
Nov 13 17:33:33 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:33:33 user nova-compute[75100]:     </video>
Nov 13 17:33:33 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:33:33 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:33:33 user nova-compute[75100]:     </rng>
Nov 13 17:33:33 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:33:33 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:33:33 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:33:33 user nova-compute[75100]:     </memballoon>
Nov 13 17:33:33 user nova-compute[75100]:   </devices>
Nov 13 17:33:33 user nova-compute[75100]: </domain>
Nov 13 17:33:33 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:33:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.827s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'trusted_certs' on Instance uuid a5f308a2-3b44-476e-85ab-15e1bf107968 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.objects.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Object Instance<a5f308a2-3b44-476e-85ab-15e1bf107968> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Cannot resize image /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'migration_context' on Instance uuid a5f308a2-3b44-476e-85ab-15e1bf107968 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.objects.base [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Object Instance<a5f308a2-3b44-476e-85ab-15e1bf107968> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1606415269',display_name='tempest-TestMinimumBasicScenario-server-1606415269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1606415269',id=31,image_ref='f54422c8-8a7d-4261-92b2-7a48a86048b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbFqeEjBCfPtchoBTJKqBMlcdgUsNVL+XmYOfHVgKSjpw6C8LgkXx5dtm92oBIN3q6lU1BKohKSabIcLqYDIWoqeuTkgxt+/aS5wfehrXw5XF1uomKZNkQcH7ewifI6Rw==',key_name='tempest-TestMinimumBasicScenario-754296732',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='dca12c426d0c495b80b77b8ae26be4eb',ramdisk_id='',reservation_id='r-7oh5r93s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f54422c8-8a7d-4261-92b2-7a48a86048b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1769966982',owner_user_name='tempest-TestMinimumBasicScenario-1769966982-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:33:31Z,user_data=None,user_id='2ba71ec67c664e94a71cc9f9107303a5',uuid=a5f308a2-3b44-476e-85ab-15e1bf107968,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converting VIF {"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG os_vif [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c38fe3b-e86f-589c-9fe5-db62bbffccf8', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f5b2945-ec, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f5b2945-ec, col_values=(('qos', UUID('058aaf01-7dda-4527-bb1e-795839d89013')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f5b2945-ec, col_values=(('external_ids', {'iface-id': '3f5b2945-ec9f-48e7-ada2-3c0cce2f8271', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:03:2a', 'vm-uuid': 'a5f308a2-3b44-476e-85ab-15e1bf107968'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:33:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:34 user nova-compute[75100]: INFO os_vif [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec')
Nov 13 17:33:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:35 user nova-compute[75100]: INFO nova.compute.manager [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Detaching volume 7aefe5dc-7027-410c-ba6b-988a2f0043e7
Nov 13 17:33:35 user nova-compute[75100]: INFO nova.virt.block_device [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Attempting to driver detach volume 7aefe5dc-7027-410c-ba6b-988a2f0043e7 from mountpoint /dev/vdb
Nov 13 17:33:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Attempting to detach device vdb from instance d30816f4-82ec-43b9-bd47-f34190e5c82f from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:33:35 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:33:35 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 13 17:33:35 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:33:35 user nova-compute[75100]:   <serial>7aefe5dc-7027-410c-ba6b-988a2f0043e7</serial>
Nov 13 17:33:35 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:33:35 user nova-compute[75100]: </disk>
Nov 13 17:33:35 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:33:35 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Successfully detached device vdb from instance d30816f4-82ec-43b9-bd47-f34190e5c82f from the persistent domain config.
Nov 13 17:33:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d30816f4-82ec-43b9-bd47-f34190e5c82f from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:33:35 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:33:35 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 13 17:33:35 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:33:35 user nova-compute[75100]:   <serial>7aefe5dc-7027-410c-ba6b-988a2f0043e7</serial>
Nov 13 17:33:35 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:33:35 user nova-compute[75100]: </disk>
Nov 13 17:33:35 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-changed-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Refreshing instance network info cache due to event network-changed-46c2fa4e-5fb5-4798-b9b0-dcf9536addac. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] Acquiring lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] Acquired lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:33:35 user nova-compute[75100]: DEBUG nova.network.neutron [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Refreshing network info cache for port 46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updated VIF entry in instance network info cache for port 46c2fa4e-5fb5-4798-b9b0-dcf9536addac. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updating instance_info_cache with network_info: [{"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] Releasing lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-changed-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Refreshing instance network info cache due to event network-changed-46c2fa4e-5fb5-4798-b9b0-dcf9536addac. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] Acquiring lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] Acquired lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Refreshing network info cache for port 46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updated VIF entry in instance network info cache for port 46c2fa4e-5fb5-4798-b9b0-dcf9536addac. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updating instance_info_cache with network_info: [{"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5faff3f5-4bf8-4c41-80e7-340182b06cdf req-5fb1a664-ebbc-42ae-9a67-5c8a51523a25 service nova] Releasing lock "refresh_cache-d30816f4-82ec-43b9-bd47-f34190e5c82f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-68a67e37-3097-40a2-a798-ea63486932ae req-89657fb4-9c1d-4214-9c4e-8f20d3d5dd64 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-68a67e37-3097-40a2-a798-ea63486932ae req-89657fb4-9c1d-4214-9c4e-8f20d3d5dd64 service nova] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-68a67e37-3097-40a2-a798-ea63486932ae req-89657fb4-9c1d-4214-9c4e-8f20d3d5dd64 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-68a67e37-3097-40a2-a798-ea63486932ae req-89657fb4-9c1d-4214-9c4e-8f20d3d5dd64 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-68a67e37-3097-40a2-a798-ea63486932ae req-89657fb4-9c1d-4214-9c4e-8f20d3d5dd64 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] No waiting events found dispatching network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:37 user nova-compute[75100]: WARNING nova.compute.manager [req-68a67e37-3097-40a2-a798-ea63486932ae req-89657fb4-9c1d-4214-9c4e-8f20d3d5dd64 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received unexpected event network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 for instance with vm_state active and task_state reboot_started_hard.
Nov 13 17:33:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-68a67e37-3097-40a2-a798-ea63486932ae req-89657fb4-9c1d-4214-9c4e-8f20d3d5dd64 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-68a67e37-3097-40a2-a798-ea63486932ae req-89657fb4-9c1d-4214-9c4e-8f20d3d5dd64 service nova] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-68a67e37-3097-40a2-a798-ea63486932ae req-89657fb4-9c1d-4214-9c4e-8f20d3d5dd64 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-68a67e37-3097-40a2-a798-ea63486932ae req-89657fb4-9c1d-4214-9c4e-8f20d3d5dd64 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-68a67e37-3097-40a2-a798-ea63486932ae req-89657fb4-9c1d-4214-9c4e-8f20d3d5dd64 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] No waiting events found dispatching network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:37 user nova-compute[75100]: WARNING nova.compute.manager [req-68a67e37-3097-40a2-a798-ea63486932ae req-89657fb4-9c1d-4214-9c4e-8f20d3d5dd64 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received unexpected event network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 for instance with vm_state active and task_state reboot_started_hard.
Nov 13 17:33:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:33:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:33:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Instance rebooted successfully.
Nov 13 17:33:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:33:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-78dba3e3-7477-42bd-abcf-239d50619402 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.613s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:40 user nova-compute[75100]: INFO nova.compute.manager [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Rescuing
Nov 13 17:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "refresh_cache-3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquired lock "refresh_cache-3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:33:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:33:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Updating instance_info_cache with network_info: [{"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Releasing lock "refresh_cache-3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-7b7a7f2d-a675-4c8c-a95f-e2229dbad0ec req-00ca87a2-debd-4fa1-aef6-ab5bd185820e service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-unplugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7b7a7f2d-a675-4c8c-a95f-e2229dbad0ec req-00ca87a2-debd-4fa1-aef6-ab5bd185820e service nova] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7b7a7f2d-a675-4c8c-a95f-e2229dbad0ec req-00ca87a2-debd-4fa1-aef6-ab5bd185820e service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7b7a7f2d-a675-4c8c-a95f-e2229dbad0ec req-00ca87a2-debd-4fa1-aef6-ab5bd185820e service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-7b7a7f2d-a675-4c8c-a95f-e2229dbad0ec req-00ca87a2-debd-4fa1-aef6-ab5bd185820e service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] No waiting events found dispatching network-vif-unplugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:41 user nova-compute[75100]: WARNING nova.compute.manager [req-7b7a7f2d-a675-4c8c-a95f-e2229dbad0ec req-00ca87a2-debd-4fa1-aef6-ab5bd185820e service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received unexpected event network-vif-unplugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 for instance with vm_state active and task_state rescuing.
Nov 13 17:33:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Instance destroyed successfully.
Nov 13 17:33:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Attempting a stable device rescue
Nov 13 17:33:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75100) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 17:33:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Instance directory exists: not creating {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 17:33:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Creating image(s)
Nov 13 17:33:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "/opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "/opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:41 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "07f0265ad06627d124df90fce7e2bfbf2d148d96" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "07f0265ad06627d124df90fce7e2bfbf2d148d96" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:42 user nova-compute[75100]: DEBUG nova.virt.images [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] 271cf8e3-d9de-4328-ba75-fda58428d116 was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96.part /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-48f34834-357b-43d9-8015-d6a787d3878f req-a73c20cc-48fa-4dab-87ba-4ac188a260db service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-48f34834-357b-43d9-8015-d6a787d3878f req-a73c20cc-48fa-4dab-87ba-4ac188a260db service nova] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-48f34834-357b-43d9-8015-d6a787d3878f req-a73c20cc-48fa-4dab-87ba-4ac188a260db service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-48f34834-357b-43d9-8015-d6a787d3878f req-a73c20cc-48fa-4dab-87ba-4ac188a260db service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.compute.manager [req-48f34834-357b-43d9-8015-d6a787d3878f req-a73c20cc-48fa-4dab-87ba-4ac188a260db service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] No waiting events found dispatching network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:43 user nova-compute[75100]: WARNING nova.compute.manager [req-48f34834-357b-43d9-8015-d6a787d3878f req-a73c20cc-48fa-4dab-87ba-4ac188a260db service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received unexpected event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 for instance with vm_state active and task_state rescuing.
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96.part /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96.converted" returned: 0 in 0.485s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "07f0265ad06627d124df90fce7e2bfbf2d148d96" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.024s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "07f0265ad06627d124df90fce7e2bfbf2d148d96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "07f0265ad06627d124df90fce7e2bfbf2d148d96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96,backing_fmt=raw /opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/disk.rescue {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96,backing_fmt=raw /opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/disk.rescue" returned: 0 in 0.048s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "07f0265ad06627d124df90fce7e2bfbf2d148d96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'migration_context' on Instance uuid 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.objects.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Object Instance<3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Start _get_guest_xml network_info=[{"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "vif_mac": "fa:16:3e:b0:5b:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '271cf8e3-d9de-4328-ba75-fda58428d116', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '0a2b63a7-7460-487d-96ec-e008e1854a1e', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXwpEWvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2', 'attached_at': '', 'detached_at': '', 'volume_id': '535e4944-841b-4ec9-bf5a-75871b15f6ea', 'serial': '535e4944-841b-4ec9-bf5a-75871b15f6ea'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'resources' on Instance uuid 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.objects.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Object Instance<3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.objects.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Object Instance<3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:43 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:33:43 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:33:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.objects.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Object Instance<3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXwpEWvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:33:44 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:33:44 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:33:44 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8d5abf-007b-437d-983c-5456b1bba774]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tXwpEWvf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 17:33:44 user nova-compute[75100]: node.name = iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:33:44 user nova-compute[75100]: node.tpgt = -1
Nov 13 17:33:44 user nova-compute[75100]: node.startup = automatic
Nov 13 17:33:44 user nova-compute[75100]: node.leading_login = No
Nov 13 17:33:44 user nova-compute[75100]: iface.iscsi_ifacename = default
Nov 13 17:33:44 user nova-compute[75100]: iface.net_ifacename = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.ipaddress = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.prefix_len = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.hwaddress = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.transport_name = tcp
Nov 13 17:33:44 user nova-compute[75100]: iface.initiatorname = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.state = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.vlan_id = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.vlan_priority = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.vlan_state = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.iface_num = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.mtu = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.port = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.bootproto = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.subnet_mask = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.gateway = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.dhcp_alt_client_id = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.dhcp_dns = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.dhcp_learn_iqn = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.dhcp_vendor_id_state = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.dhcp_vendor_id = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.dhcp_slp_da = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.fragmentation = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.gratuitous_arp = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.incoming_forwarding = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.tos_state = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.tos = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.ttl = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.delayed_ack = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.tcp_nagle = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.tcp_wsf_state = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.tcp_wsf = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.tcp_timer_scale = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.tcp_timestamp = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.redirect = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.def_task_mgmt_timeout = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.header_digest = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.data_digest = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.immediate_data = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.initial_r2t = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.data_seq_inorder = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.data_pdu_inorder = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.erl = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.max_receive_data_len = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.first_burst_len = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.max_outstanding_r2t = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.max_burst_len = 0
Nov 13 17:33:44 user nova-compute[75100]: iface.chap_auth = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.bidi_chap = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.strict_login_compliance = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.discovery_auth = <empty>
Nov 13 17:33:44 user nova-compute[75100]: iface.discovery_logout = <empty>
Nov 13 17:33:44 user nova-compute[75100]: node.discovery_address = <empty>
Nov 13 17:33:44 user nova-compute[75100]: node.discovery_port = 0
Nov 13 17:33:44 user nova-compute[75100]: node.discovery_type = static
Nov 13 17:33:44 user nova-compute[75100]: node.session.initial_cmdsn = 0
Nov 13 17:33:44 user nova-compute[75100]: node.session.initial_login_retry_max = 8
Nov 13 17:33:44 user nova-compute[75100]: node.session.xmit_thread_priority = -20
Nov 13 17:33:44 user nova-compute[75100]: node.session.cmds_max = 128
Nov 13 17:33:44 user nova-compute[75100]: node.session.queue_depth = 32
Nov 13 17:33:44 user nova-compute[75100]: node.session.nr_sessions = 1
Nov 13 17:33:44 user nova-compute[75100]: node.session.auth.authmethod = CHAP
Nov 13 17:33:44 user nova-compute[75100]: node.session.auth.username = tXwpEWvf
Nov 13 17:33:44 user nova-compute[75100]: node.session.auth.password = ***
Nov 13 17:33:44 user nova-compute[75100]: node.session.auth.username_in = <empty>
Nov 13 17:33:44 user nova-compute[75100]: node.session.auth.password_in = <empty>
Nov 13 17:33:44 user nova-compute[75100]: node.session.auth.chap_algs = MD5
Nov 13 17:33:44 user nova-compute[75100]: node.session.timeo.replacement_timeout = 120
Nov 13 17:33:44 user nova-compute[75100]: node.session.err_timeo.abort_timeout = 15
Nov 13 17:33:44 user nova-compute[75100]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 17:33:44 user nova-compute[75100]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 17:33:44 user nova-compute[75100]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 17:33:44 user nova-compute[75100]: node.session.iscsi.FastAbort = Yes
Nov 13 17:33:44 user nova-compute[75100]: node.session.iscsi.InitialR2T = No
Nov 13 17:33:44 user nova-compute[75100]: node.session.iscsi.ImmediateData = Yes
Nov 13 17:33:44 user nova-compute[75100]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 17:33:44 user nova-compute[75100]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 17:33:44 user nova-compute[75100]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 17:33:44 user nova-compute[75100]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 17:33:44 user nova-compute[75100]: node.session.iscsi.MaxConnections = 1
Nov 13 17:33:44 user nova-compute[75100]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 17:33:44 user nova-compute[75100]: node.session.iscsi.ERL = 0
Nov 13 17:33:44 user nova-compute[75100]: node.session.scan = manual
Nov 13 17:33:44 user nova-compute[75100]: node.session.reopen_max = 0
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].address = 172.16.0.220
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].port = 3260
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].startup = manual
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].tcp.window_size = 524288
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].tcp.type_of_service = 0
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].timeo.logout_timeout = 15
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].timeo.login_timeout = 15
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].timeo.auth_timeout = 45
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].iscsi.DataDigest = None
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].iscsi.IFMarker = No
Nov 13 17:33:44 user nova-compute[75100]: node.conn[0].iscsi.OFMarker = No
Nov 13 17:33:44 user nova-compute[75100]: # END RECORD
Nov 13 17:33:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[854e5fe4-c13a-492a-b393-470ca5f2dd9f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1521236-c29e-43d0-8a1d-3a1ce987fbf1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXwpEWvf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXwpEWvf" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8925dc0-2453-4d56-bc6f-e43d4b49bf06]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tXwpEWvf'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af505548-9808-4ccd-ab2c-74ef23ca4374]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c4f1e0-ad10-41b3-aeca-95b0f5201f1f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:33:44 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.149s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] HCTL ('37', '0', '0', 0) found on session 35 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[801a4278-e5f4-41f2-ac0c-ce399c418b81]: (4, ('0 0 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Searching for a device in session 35 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXwpEWvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.173s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] <== connect_volume: return (175ms) {'type': 'block', 'scsi_wwn': '26564356636356636', 'path': '/dev/sdf'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564356636356636', 'path': '/dev/sdf'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-651335238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-651335238',id=32,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:32:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-io0vancg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:32:05Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "vif_mac": "fa:16:3e:b0:5b:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "vif_mac": "fa:16:3e:b0:5b:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=ba1c3e90-566f-4b88-8f8c-1b100eea3621,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1c3e90-56') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.objects.base [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Object Instance<3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:33:44 user nova-compute[75100]:   <uuid>3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2</uuid>
Nov 13 17:33:44 user nova-compute[75100]:   <name>instance-00000020</name>
Nov 13 17:33:44 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:33:44 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:33:44 user nova-compute[75100]:   <metadata>
Nov 13 17:33:44 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:33:44 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:33:44 user nova-compute[75100]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-651335238</nova:name>
Nov 13 17:33:44 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:33:43</nova:creationTime>
Nov 13 17:33:44 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:33:44 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:33:44 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:33:44 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:33:44 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:33:44 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:33:44 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:33:44 user nova-compute[75100]:       <nova:owner>
Nov 13 17:33:44 user nova-compute[75100]:         <nova:user uuid="77f5fd132c0e46438884eaffae0beab9">tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member</nova:user>
Nov 13 17:33:44 user nova-compute[75100]:         <nova:project uuid="f1bf7bde4b774e3dac46d41d32496efa">tempest-ServerBootFromVolumeStableRescueTest-1217233624</nova:project>
Nov 13 17:33:44 user nova-compute[75100]:       </nova:owner>
Nov 13 17:33:44 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:33:44 user nova-compute[75100]:       <nova:ports>
Nov 13 17:33:44 user nova-compute[75100]:         <nova:port uuid="ba1c3e90-566f-4b88-8f8c-1b100eea3621">
Nov 13 17:33:44 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:33:44 user nova-compute[75100]:         </nova:port>
Nov 13 17:33:44 user nova-compute[75100]:       </nova:ports>
Nov 13 17:33:44 user nova-compute[75100]:     </nova:instance>
Nov 13 17:33:44 user nova-compute[75100]:   </metadata>
Nov 13 17:33:44 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:33:44 user nova-compute[75100]:     <system>
Nov 13 17:33:44 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:33:44 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:33:44 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:33:44 user nova-compute[75100]:       <entry name="serial">3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2</entry>
Nov 13 17:33:44 user nova-compute[75100]:       <entry name="uuid">3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2</entry>
Nov 13 17:33:44 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:33:44 user nova-compute[75100]:     </system>
Nov 13 17:33:44 user nova-compute[75100]:   </sysinfo>
Nov 13 17:33:44 user nova-compute[75100]:   <os>
Nov 13 17:33:44 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:33:44 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:33:44 user nova-compute[75100]:   </os>
Nov 13 17:33:44 user nova-compute[75100]:   <features>
Nov 13 17:33:44 user nova-compute[75100]:     <acpi/>
Nov 13 17:33:44 user nova-compute[75100]:     <apic/>
Nov 13 17:33:44 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:33:44 user nova-compute[75100]:   </features>
Nov 13 17:33:44 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:33:44 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:33:44 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:33:44 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:33:44 user nova-compute[75100]:   </clock>
Nov 13 17:33:44 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:33:44 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:33:44 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:33:44 user nova-compute[75100]:   </cpu>
Nov 13 17:33:44 user nova-compute[75100]:   <devices>
Nov 13 17:33:44 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:33:44 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:33:44 user nova-compute[75100]:       <source dev="/dev/sdf"/>
Nov 13 17:33:44 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:33:44 user nova-compute[75100]:       <serial>535e4944-841b-4ec9-bf5a-75871b15f6ea</serial>
Nov 13 17:33:44 user nova-compute[75100]:     </disk>
Nov 13 17:33:44 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:33:44 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:33:44 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/disk.rescue"/>
Nov 13 17:33:44 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:33:44 user nova-compute[75100]:       <boot order="1"/>
Nov 13 17:33:44 user nova-compute[75100]:     </disk>
Nov 13 17:33:44 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:33:44 user nova-compute[75100]:       <mac address="fa:16:3e:b0:5b:8d"/>
Nov 13 17:33:44 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:33:44 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:33:44 user nova-compute[75100]:       <target dev="tapba1c3e90-56"/>
Nov 13 17:33:44 user nova-compute[75100]:     </interface>
Nov 13 17:33:44 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:33:44 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/console.log" append="off"/>
Nov 13 17:33:44 user nova-compute[75100]:     </serial>
Nov 13 17:33:44 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:33:44 user nova-compute[75100]:     <video>
Nov 13 17:33:44 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:33:44 user nova-compute[75100]:     </video>
Nov 13 17:33:44 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:33:44 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:33:44 user nova-compute[75100]:     </rng>
Nov 13 17:33:44 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:33:44 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:33:44 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:33:44 user nova-compute[75100]:     </memballoon>
Nov 13 17:33:44 user nova-compute[75100]:   </devices>
Nov 13 17:33:44 user nova-compute[75100]: </domain>
Nov 13 17:33:44 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:33:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Instance destroyed successfully.
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] No VIF found with MAC fa:16:3e:b0:5b:8d, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:33:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-3d018fd6-c21f-4178-876d-ac649c95f1d3 req-7ebfd13a-aee3-4305-bf3a-db3d8888ebdf service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3d018fd6-c21f-4178-876d-ac649c95f1d3 req-7ebfd13a-aee3-4305-bf3a-db3d8888ebdf service nova] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3d018fd6-c21f-4178-876d-ac649c95f1d3 req-7ebfd13a-aee3-4305-bf3a-db3d8888ebdf service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3d018fd6-c21f-4178-876d-ac649c95f1d3 req-7ebfd13a-aee3-4305-bf3a-db3d8888ebdf service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:45 user nova-compute[75100]: DEBUG nova.compute.manager [req-3d018fd6-c21f-4178-876d-ac649c95f1d3 req-7ebfd13a-aee3-4305-bf3a-db3d8888ebdf service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] No waiting events found dispatching network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:45 user nova-compute[75100]: WARNING nova.compute.manager [req-3d018fd6-c21f-4178-876d-ac649c95f1d3 req-7ebfd13a-aee3-4305-bf3a-db3d8888ebdf service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received unexpected event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 for instance with vm_state active and task_state rescuing.
Nov 13 17:33:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:47 user nova-compute[75100]: INFO nova.compute.manager [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Terminating instance
Nov 13 17:33:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-b2be8aaf-f8a3-40d4-a4ed-1ea7a1452379 req-d9a48625-a8bd-48ed-954f-dc7751ee4a24 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-vif-unplugged-06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b2be8aaf-f8a3-40d4-a4ed-1ea7a1452379 req-d9a48625-a8bd-48ed-954f-dc7751ee4a24 service nova] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b2be8aaf-f8a3-40d4-a4ed-1ea7a1452379 req-d9a48625-a8bd-48ed-954f-dc7751ee4a24 service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b2be8aaf-f8a3-40d4-a4ed-1ea7a1452379 req-d9a48625-a8bd-48ed-954f-dc7751ee4a24 service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-b2be8aaf-f8a3-40d4-a4ed-1ea7a1452379 req-d9a48625-a8bd-48ed-954f-dc7751ee4a24 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] No waiting events found dispatching network-vif-unplugged-06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-b2be8aaf-f8a3-40d4-a4ed-1ea7a1452379 req-d9a48625-a8bd-48ed-954f-dc7751ee4a24 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-vif-unplugged-06242103-0705-434a-8b09-54be30f73283 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-4d966b84-5755-460c-8c88-2ffc4ec8dd28 req-bc7c3736-56ef-40ce-a5b7-46fddc8b7027 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4d966b84-5755-460c-8c88-2ffc4ec8dd28 req-bc7c3736-56ef-40ce-a5b7-46fddc8b7027 service nova] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4d966b84-5755-460c-8c88-2ffc4ec8dd28 req-bc7c3736-56ef-40ce-a5b7-46fddc8b7027 service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4d966b84-5755-460c-8c88-2ffc4ec8dd28 req-bc7c3736-56ef-40ce-a5b7-46fddc8b7027 service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:47 user nova-compute[75100]: DEBUG nova.compute.manager [req-4d966b84-5755-460c-8c88-2ffc4ec8dd28 req-bc7c3736-56ef-40ce-a5b7-46fddc8b7027 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] No waiting events found dispatching network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:47 user nova-compute[75100]: WARNING nova.compute.manager [req-4d966b84-5755-460c-8c88-2ffc4ec8dd28 req-bc7c3736-56ef-40ce-a5b7-46fddc8b7027 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received unexpected event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 for instance with vm_state active and task_state rescuing.
Nov 13 17:33:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bb9a9162-721b-4545-8989-568962c23f21 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:33:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Instance destroyed successfully.
Nov 13 17:33:48 user nova-compute[75100]: DEBUG nova.objects.instance [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lazy-loading 'resources' on Instance uuid bcb48f07-30a1-48a1-b739-49bf2513c013 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:30:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1119793217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1119793217',id=28,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvx8JQIBkL21nN5cuKYIjTT8NnZAWSZMP2QkZAc6pbLZaJgU2fYiAQEBg0Xgdwf3KsbdPq5Sf/a+dIZy7MOu0OovA6J7QJWFX9Lec9YN4YQPY7+toKNUPqHUKmWixmRqw==',key_name='tempest-keypair-1552872187',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48b8e980410348b48bf04fc382c4e60c',ramdisk_id='',reservation_id='r-n03514yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1699715910',owner_user_name='tempest-TaggedAttachmentsTest-1699715910-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b10372a7ca7845d8970b4f957afd249d',uuid=bcb48f07-30a1-48a1-b739-49bf2513c013,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converting VIF {"id": "06242103-0705-434a-8b09-54be30f73283", "address": "fa:16:3e:3b:85:9d", "network": {"id": "fa03dec8-6055-44af-ae76-a694d6f84136", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-749756315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48b8e980410348b48bf04fc382c4e60c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06242103-07", "ovs_interfaceid": "06242103-0705-434a-8b09-54be30f73283", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:85:9d,bridge_name='br-int',has_traffic_filtering=True,id=06242103-0705-434a-8b09-54be30f73283,network=Network(fa03dec8-6055-44af-ae76-a694d6f84136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06242103-07') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG os_vif [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:85:9d,bridge_name='br-int',has_traffic_filtering=True,id=06242103-0705-434a-8b09-54be30f73283,network=Network(fa03dec8-6055-44af-ae76-a694d6f84136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06242103-07') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06242103-07, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57a9fc80-c5bb-4a9d-932e-f9cadd4584ff) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:33:48 user nova-compute[75100]: INFO os_vif [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:85:9d,bridge_name='br-int',has_traffic_filtering=True,id=06242103-0705-434a-8b09-54be30f73283,network=Network(fa03dec8-6055-44af-ae76-a694d6f84136),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06242103-07')
Nov 13 17:33:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Deleting instance files /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013_del
Nov 13 17:33:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Deletion of /opt/stack/data/nova/instances/bcb48f07-30a1-48a1-b739-49bf2513c013_del complete
Nov 13 17:33:48 user nova-compute[75100]: INFO nova.compute.manager [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 17:33:48 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:33:48 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:33:49 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:33:49 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Took 0.79 seconds to deallocate network for instance.
Nov 13 17:33:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:49 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:33:49 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:33:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-a5d0243a-6962-4488-9853-d3dc63e41693 req-a012aa97-a3ac-4023-9a4d-3aa40a3be83c service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-vif-plugged-06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a5d0243a-6962-4488-9853-d3dc63e41693 req-a012aa97-a3ac-4023-9a4d-3aa40a3be83c service nova] Acquiring lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:33:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a5d0243a-6962-4488-9853-d3dc63e41693 req-a012aa97-a3ac-4023-9a4d-3aa40a3be83c service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:33:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a5d0243a-6962-4488-9853-d3dc63e41693 req-a012aa97-a3ac-4023-9a4d-3aa40a3be83c service nova] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:49 user nova-compute[75100]: DEBUG nova.compute.manager [req-a5d0243a-6962-4488-9853-d3dc63e41693 req-a012aa97-a3ac-4023-9a4d-3aa40a3be83c service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] No waiting events found dispatching network-vif-plugged-06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:33:49 user nova-compute[75100]: WARNING nova.compute.manager [req-a5d0243a-6962-4488-9853-d3dc63e41693 req-a012aa97-a3ac-4023-9a4d-3aa40a3be83c service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received unexpected event network-vif-plugged-06242103-0705-434a-8b09-54be30f73283 for instance with vm_state deleted and task_state None.
Nov 13 17:33:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.599s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-4b87f93b-00e1-4913-96c8-9b9d526a7c90 req-03c13911-9d3a-4a96-95ed-a7217c6e0400 service nova] [instance: bcb48f07-30a1-48a1-b739-49bf2513c013] Received event network-vif-deleted-06242103-0705-434a-8b09-54be30f73283 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:33:50 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Deleted allocations for instance bcb48f07-30a1-48a1-b739-49bf2513c013
Nov 13 17:33:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-012065e4-a573-4145-9be5-83759c2d9ea4 tempest-TaggedAttachmentsTest-1699715910 tempest-TaggedAttachmentsTest-1699715910-project-member] Lock "bcb48f07-30a1-48a1-b739-49bf2513c013" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.607s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d30816f4-82ec-43b9-bd47-f34190e5c82f is timed out.
Nov 13 17:33:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Successfully detached device vdb from instance d30816f4-82ec-43b9-bd47-f34190e5c82f from the live domain config.
Nov 13 17:33:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQkJEpdM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:33:55 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f27c51-ed70-48ed-9571-7cc0bcdffafd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:33:55 user nova-compute[75100]: No targets found.
Nov 13 17:33:55 user nova-compute[75100]: iSNS:
Nov 13 17:33:55 user nova-compute[75100]: No targets found.
Nov 13 17:33:55 user nova-compute[75100]: STATIC:
Nov 13 17:33:55 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:33:55 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:55 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:55 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c
Nov 13 17:33:55 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:55 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:55 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22
Nov 13 17:33:55 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:55 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:55 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7
Nov 13 17:33:55 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:55 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:55 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da
Nov 13 17:33:55 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:55 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:55 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:33:55 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:55 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:55 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2
Nov 13 17:33:55 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:55 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:55 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:33:55 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:33:55 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:33:55 user nova-compute[75100]: FIRMWARE:
Nov 13 17:33:55 user nova-compute[75100]: No targets found.
Nov 13 17:33:55 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:33:55 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:33:55 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e508de-30d1-442e-8e4a-6df70aadb446]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e27f32-16cc-4303-9906-4f1bb34cac98]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:55 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:33:55 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:33:55 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38f748b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bbcb41-468d-40ff-8a93-03c4e383183a]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff0c35d-1c4f-4322-bd89-1b3e007bcb14]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca27e84-bcee-4d4e-aa8c-d3f3d75d26d3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0e549d-69b2-44d1-9919-c72687e7ef06]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67d71ac-d76f-45fc-8072-5b4b3d2dc791]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[05743cc6-fb87-49e1-9831-b210acf36fe8]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7, portal: 172.16.0.220,3260]
Nov 13 17:33:56 user nova-compute[75100]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7, portal: 172.16.0.220,3260] successful.
Nov 13 17:33:56 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:33:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7aefe5dc-7027-410c-ba6b-988a2f0043e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:33:56 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f85e656-96e7-442b-89cd-7451ae05b4f9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:33:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:33:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:33:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] <== disconnect_volume: return (330ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:33:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:33:56 user nova-compute[75100]: DEBUG nova.objects.instance [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'flavor' on Instance uuid d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:33:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-00b7d767-540f-4cd6-9865-0f77803672bf tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.813s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:33:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:33:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:02 user nova-compute[75100]: INFO nova.compute.manager [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Terminating instance
Nov 13 17:34:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:34:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8e92c9b0-a065-4d81-999b-f1b5169181bf req-7344bd69-f4fd-44ac-abad-1aaf42a385b1 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-unplugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8e92c9b0-a065-4d81-999b-f1b5169181bf req-7344bd69-f4fd-44ac-abad-1aaf42a385b1 service nova] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8e92c9b0-a065-4d81-999b-f1b5169181bf req-7344bd69-f4fd-44ac-abad-1aaf42a385b1 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8e92c9b0-a065-4d81-999b-f1b5169181bf req-7344bd69-f4fd-44ac-abad-1aaf42a385b1 service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8e92c9b0-a065-4d81-999b-f1b5169181bf req-7344bd69-f4fd-44ac-abad-1aaf42a385b1 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] No waiting events found dispatching network-vif-unplugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-8e92c9b0-a065-4d81-999b-f1b5169181bf req-7344bd69-f4fd-44ac-abad-1aaf42a385b1 service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-unplugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Instance destroyed successfully.
Nov 13 17:34:03 user nova-compute[75100]: DEBUG nova.objects.instance [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'resources' on Instance uuid d2c4575b-ef8d-4a9d-9650-459366b7227e {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:24:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-562088828',display_name='tempest-AttachVolumeTestJSON-server-562088828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-562088828',id=18,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0MMK9PR6LTDNy8k+1ome/7/JGCOaYN5Lt3qsENjyVjimlQSRra7KUpWuRZjUfo9P1bMI6EsGXlo4/Ypy8Z5ugzSg6hpliFDTFbfMjRXxyPD7FFbeVCCUZ1dM7RZ0z3bQ==',key_name='tempest-keypair-673460478',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43327ade8a814488bb141835e2ac331b',ramdisk_id='',reservation_id='r-4p2x10pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2091682056',owner_user_name='tempest-AttachVolumeTestJSON-2091682056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:32:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15122cbfe21b4775b679285eeb4beff7',uuid=d2c4575b-ef8d-4a9d-9650-459366b7227e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converting VIF {"id": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "address": "fa:16:3e:00:52:b6", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb5ab2c-fa", "ovs_interfaceid": "0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG os_vif [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bb5ab2c-fa, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7575f4a1-6198-44a3-b82c-53734614d6da) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:03 user nova-compute[75100]: INFO os_vif [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:52:b6,bridge_name='br-int',has_traffic_filtering=True,id=0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb5ab2c-fa')
Nov 13 17:34:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Deleting instance files /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e_del
Nov 13 17:34:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Deletion of /opt/stack/data/nova/instances/d2c4575b-ef8d-4a9d-9650-459366b7227e_del complete
Nov 13 17:34:03 user nova-compute[75100]: INFO nova.compute.manager [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 13 17:34:03 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:34:03 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:34:04 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:34:04 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Took 0.68 seconds to deallocate network for instance.
Nov 13 17:34:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:04 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:34:04 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:34:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:04 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Deleted allocations for instance d2c4575b-ef8d-4a9d-9650-459366b7227e
Nov 13 17:34:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-685850c8-747c-4990-882f-082d394d0ec2 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.946s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-595e3833-be7e-4d23-9007-dae70688e5c8 req-e2df163a-37f6-4bda-830e-a919c51378ba service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:34:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-595e3833-be7e-4d23-9007-dae70688e5c8 req-e2df163a-37f6-4bda-830e-a919c51378ba service nova] Acquiring lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-595e3833-be7e-4d23-9007-dae70688e5c8 req-e2df163a-37f6-4bda-830e-a919c51378ba service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-595e3833-be7e-4d23-9007-dae70688e5c8 req-e2df163a-37f6-4bda-830e-a919c51378ba service nova] Lock "d2c4575b-ef8d-4a9d-9650-459366b7227e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-595e3833-be7e-4d23-9007-dae70688e5c8 req-e2df163a-37f6-4bda-830e-a919c51378ba service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] No waiting events found dispatching network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:34:05 user nova-compute[75100]: WARNING nova.compute.manager [req-595e3833-be7e-4d23-9007-dae70688e5c8 req-e2df163a-37f6-4bda-830e-a919c51378ba service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received unexpected event network-vif-plugged-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd for instance with vm_state deleted and task_state None.
Nov 13 17:34:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-595e3833-be7e-4d23-9007-dae70688e5c8 req-e2df163a-37f6-4bda-830e-a919c51378ba service nova] [instance: d2c4575b-ef8d-4a9d-9650-459366b7227e] Received event network-vif-deleted-0bb5ab2c-fa3f-491c-bb57-4f928cbe22fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:34:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:25 user nova-compute[75100]: INFO nova.compute.manager [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Terminating instance
Nov 13 17:34:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-97dc6cb2-6c3e-442a-a91d-8ced08ef0c35 req-28712e17-aa78-4aea-9b58-e8a33c2afc09 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-unplugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97dc6cb2-6c3e-442a-a91d-8ced08ef0c35 req-28712e17-aa78-4aea-9b58-e8a33c2afc09 service nova] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97dc6cb2-6c3e-442a-a91d-8ced08ef0c35 req-28712e17-aa78-4aea-9b58-e8a33c2afc09 service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-97dc6cb2-6c3e-442a-a91d-8ced08ef0c35 req-28712e17-aa78-4aea-9b58-e8a33c2afc09 service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-97dc6cb2-6c3e-442a-a91d-8ced08ef0c35 req-28712e17-aa78-4aea-9b58-e8a33c2afc09 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] No waiting events found dispatching network-vif-unplugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-97dc6cb2-6c3e-442a-a91d-8ced08ef0c35 req-28712e17-aa78-4aea-9b58-e8a33c2afc09 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-unplugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Instance destroyed successfully.
Nov 13 17:34:26 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'resources' on Instance uuid d30816f4-82ec-43b9-bd47-f34190e5c82f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:27:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1020004757',display_name='tempest-ServerRescueNegativeTestJSON-server-1020004757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1020004757',id=24,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG40rnWNdDGw6MfW9fJQy1Qo+Xea5DaDsFvBwt2VMxDpCa3aXwJVnMHiiqQw5ZYsyNK2tVKIhgW2j1pldZydkRtj1dqFcGsv+wEELqc/1VWu3BcXOz51BEeAHnpPKQUIAg==',key_name='tempest-keypair-607988464',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:29:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6c1d1cfd844465e85239be73eb73cec',ramdisk_id='',reservation_id='r-o69if3j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1273984533',owner_user_name='tempest-ServerRescueNegativeTestJSON-1273984533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:31:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='33657093c7ab4112994a1b7e997cfb34',uuid=d30816f4-82ec-43b9-bd47-f34190e5c82f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converting VIF {"id": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "address": "fa:16:3e:f0:75:c6", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46c2fa4e-5f", "ovs_interfaceid": "46c2fa4e-5fb5-4798-b9b0-dcf9536addac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=46c2fa4e-5fb5-4798-b9b0-dcf9536addac,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c2fa4e-5f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG os_vif [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=46c2fa4e-5fb5-4798-b9b0-dcf9536addac,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c2fa4e-5f') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46c2fa4e-5f, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6cbf1fe-beb3-4e2d-93ed-6e5a0a2a8e3e) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:34:26 user nova-compute[75100]: INFO os_vif [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=46c2fa4e-5fb5-4798-b9b0-dcf9536addac,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46c2fa4e-5f')
Nov 13 17:34:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Deleting instance files /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f_del
Nov 13 17:34:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Deletion of /opt/stack/data/nova/instances/d30816f4-82ec-43b9-bd47-f34190e5c82f_del complete
Nov 13 17:34:26 user nova-compute[75100]: INFO nova.compute.manager [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 13 17:34:26 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:34:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:34:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:34:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:27 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:34:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-807d51ad-7c2a-4e16-83ee-86ba03e0c260 req-79a48b68-769a-411d-a832-fee273404481 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:34:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-807d51ad-7c2a-4e16-83ee-86ba03e0c260 req-79a48b68-769a-411d-a832-fee273404481 service nova] Acquiring lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-807d51ad-7c2a-4e16-83ee-86ba03e0c260 req-79a48b68-769a-411d-a832-fee273404481 service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-807d51ad-7c2a-4e16-83ee-86ba03e0c260 req-79a48b68-769a-411d-a832-fee273404481 service nova] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-807d51ad-7c2a-4e16-83ee-86ba03e0c260 req-79a48b68-769a-411d-a832-fee273404481 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] No waiting events found dispatching network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:34:27 user nova-compute[75100]: WARNING nova.compute.manager [req-807d51ad-7c2a-4e16-83ee-86ba03e0c260 req-79a48b68-769a-411d-a832-fee273404481 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received unexpected event network-vif-plugged-46c2fa4e-5fb5-4798-b9b0-dcf9536addac for instance with vm_state active and task_state deleting.
Nov 13 17:34:27 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Took 1.52 seconds to deallocate network for instance.
Nov 13 17:34:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-18cf8634-b951-4d9a-b47d-00a82272a609 req-045a3885-e31f-4a13-a9e0-9f87103ef5b1 service nova] [instance: d30816f4-82ec-43b9-bd47-f34190e5c82f] Received event network-vif-deleted-46c2fa4e-5fb5-4798-b9b0-dcf9536addac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:34:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:28 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:34:28 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:34:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:28 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Deleted allocations for instance d30816f4-82ec-43b9-bd47-f34190e5c82f
Nov 13 17:34:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0a390248-abf4-402e-92b0-d5d177a9db81 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "d30816f4-82ec-43b9-bd47-f34190e5c82f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.016s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:34:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:34:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:34:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:29 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:34:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:34:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:34:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:34:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.rescue --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:34:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:34:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:34:33 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7342MB free_disk=24.881195068359375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Applying migration context for instance 73c5d863-7cae-481f-b8ea-dfc217514658 as it has an incoming, in-progress migration 35421aba-e45e-42f4-a2a1-b50a2e57287f. Migration status is finished {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 17:34:33 user nova-compute[75100]: INFO nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Updating resource usage from migration 35421aba-e45e-42f4-a2a1-b50a2e57287f
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance a5f308a2-3b44-476e-85ab-15e1bf107968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Migration 35421aba-e45e-42f4-a2a1-b50a2e57287f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 73c5d863-7cae-481f-b8ea-dfc217514658 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6b7d6fb7-30cb-46bd-8ec9-11d60f160350 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:34:33 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "73c5d863-7cae-481f-b8ea-dfc217514658" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Going to confirm migration 2 {{(pid=75100) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquired lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lazy-loading 'info_cache' on Instance uuid 73c5d863-7cae-481f-b8ea-dfc217514658 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Updating instance_info_cache with network_info: [{"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Releasing lock "refresh_cache-73c5d863-7cae-481f-b8ea-dfc217514658" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lazy-loading 'migration_context' on Instance uuid 73c5d863-7cae-481f-b8ea-dfc217514658 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG nova.objects.base [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Object Instance<73c5d863-7cae-481f-b8ea-dfc217514658> lazy-loaded attributes: info_cache,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.421s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:34:35 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Deleted allocation for migration 35421aba-e45e-42f4-a2a1-b50a2e57287f
Nov 13 17:34:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-06c78a67-4056-45d5-97c0-d686a42b1bb2 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "73c5d863-7cae-481f-b8ea-dfc217514658" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.329s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Updating instance_info_cache with network_info: [{"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:34:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:34:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:34:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:52 user nova-compute[75100]: INFO nova.compute.manager [None req-6670e5b0-bcb1-4571-8610-86c2032eff08 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Unrescuing
Nov 13 17:34:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6670e5b0-bcb1-4571-8610-86c2032eff08 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:34:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6670e5b0-bcb1-4571-8610-86c2032eff08 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquired lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:34:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6670e5b0-bcb1-4571-8610-86c2032eff08 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:34:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6670e5b0-bcb1-4571-8610-86c2032eff08 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updating instance_info_cache with network_info: [{"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:34:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6670e5b0-bcb1-4571-8610-86c2032eff08 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Releasing lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:34:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6670e5b0-bcb1-4571-8610-86c2032eff08 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lazy-loading 'flavor' on Instance uuid 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-b57318e4-6458-441e-be63-39495a838208 req-42030623-04f0-41b1-a0c4-ce591bd44020 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-unplugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b57318e4-6458-441e-be63-39495a838208 req-42030623-04f0-41b1-a0c4-ce591bd44020 service nova] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b57318e4-6458-441e-be63-39495a838208 req-42030623-04f0-41b1-a0c4-ce591bd44020 service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b57318e4-6458-441e-be63-39495a838208 req-42030623-04f0-41b1-a0c4-ce591bd44020 service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-b57318e4-6458-441e-be63-39495a838208 req-42030623-04f0-41b1-a0c4-ce591bd44020 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] No waiting events found dispatching network-vif-unplugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:34:53 user nova-compute[75100]: WARNING nova.compute.manager [req-b57318e4-6458-441e-be63-39495a838208 req-42030623-04f0-41b1-a0c4-ce591bd44020 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received unexpected event network-vif-unplugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:34:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-95765f31-dce8-4629-86b9-f159ae53655f req-56c101a4-d478-4d46-89b6-f27d25d5c0cf service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-changed-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-95765f31-dce8-4629-86b9-f159ae53655f req-56c101a4-d478-4d46-89b6-f27d25d5c0cf service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Refreshing instance network info cache due to event network-changed-0e4ff1c7-53c8-45ff-818e-03d897b1e954. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-95765f31-dce8-4629-86b9-f159ae53655f req-56c101a4-d478-4d46-89b6-f27d25d5c0cf service nova] Acquiring lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-95765f31-dce8-4629-86b9-f159ae53655f req-56c101a4-d478-4d46-89b6-f27d25d5c0cf service nova] Acquired lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:34:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-95765f31-dce8-4629-86b9-f159ae53655f req-56c101a4-d478-4d46-89b6-f27d25d5c0cf service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Refreshing network info cache for port 0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:34:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Instance destroyed successfully.
Nov 13 17:34:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-95765f31-dce8-4629-86b9-f159ae53655f req-56c101a4-d478-4d46-89b6-f27d25d5c0cf service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updated VIF entry in instance network info cache for port 0e4ff1c7-53c8-45ff-818e-03d897b1e954. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:34:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-95765f31-dce8-4629-86b9-f159ae53655f req-56c101a4-d478-4d46-89b6-f27d25d5c0cf service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updating instance_info_cache with network_info: [{"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:34:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-95765f31-dce8-4629-86b9-f159ae53655f req-56c101a4-d478-4d46-89b6-f27d25d5c0cf service nova] Releasing lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3fb9fa4-36e8-4a6d-aa5a-fe67eaedd42d req-9d8b6f85-c6ab-40b9-9d80-46f5e0c1504e service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb9fa4-36e8-4a6d-aa5a-fe67eaedd42d req-9d8b6f85-c6ab-40b9-9d80-46f5e0c1504e service nova] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb9fa4-36e8-4a6d-aa5a-fe67eaedd42d req-9d8b6f85-c6ab-40b9-9d80-46f5e0c1504e service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb9fa4-36e8-4a6d-aa5a-fe67eaedd42d req-9d8b6f85-c6ab-40b9-9d80-46f5e0c1504e service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3fb9fa4-36e8-4a6d-aa5a-fe67eaedd42d req-9d8b6f85-c6ab-40b9-9d80-46f5e0c1504e service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] No waiting events found dispatching network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:34:55 user nova-compute[75100]: WARNING nova.compute.manager [req-f3fb9fa4-36e8-4a6d-aa5a-fe67eaedd42d req-9d8b6f85-c6ab-40b9-9d80-46f5e0c1504e service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received unexpected event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:34:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3fb9fa4-36e8-4a6d-aa5a-fe67eaedd42d req-9d8b6f85-c6ab-40b9-9d80-46f5e0c1504e service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb9fa4-36e8-4a6d-aa5a-fe67eaedd42d req-9d8b6f85-c6ab-40b9-9d80-46f5e0c1504e service nova] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb9fa4-36e8-4a6d-aa5a-fe67eaedd42d req-9d8b6f85-c6ab-40b9-9d80-46f5e0c1504e service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3fb9fa4-36e8-4a6d-aa5a-fe67eaedd42d req-9d8b6f85-c6ab-40b9-9d80-46f5e0c1504e service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3fb9fa4-36e8-4a6d-aa5a-fe67eaedd42d req-9d8b6f85-c6ab-40b9-9d80-46f5e0c1504e service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] No waiting events found dispatching network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:34:55 user nova-compute[75100]: WARNING nova.compute.manager [req-f3fb9fa4-36e8-4a6d-aa5a-fe67eaedd42d req-9d8b6f85-c6ab-40b9-9d80-46f5e0c1504e service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received unexpected event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:34:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-96021bdc-f98e-4a2d-8bd0-ecc8939d8a1a req-57790093-96be-4f32-aa08-226e47a3532f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-changed-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-96021bdc-f98e-4a2d-8bd0-ecc8939d8a1a req-57790093-96be-4f32-aa08-226e47a3532f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Refreshing instance network info cache due to event network-changed-0e4ff1c7-53c8-45ff-818e-03d897b1e954. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-96021bdc-f98e-4a2d-8bd0-ecc8939d8a1a req-57790093-96be-4f32-aa08-226e47a3532f service nova] Acquiring lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-96021bdc-f98e-4a2d-8bd0-ecc8939d8a1a req-57790093-96be-4f32-aa08-226e47a3532f service nova] Acquired lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-96021bdc-f98e-4a2d-8bd0-ecc8939d8a1a req-57790093-96be-4f32-aa08-226e47a3532f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Refreshing network info cache for port 0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-96021bdc-f98e-4a2d-8bd0-ecc8939d8a1a req-57790093-96be-4f32-aa08-226e47a3532f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updated VIF entry in instance network info cache for port 0e4ff1c7-53c8-45ff-818e-03d897b1e954. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:34:56 user nova-compute[75100]: DEBUG nova.network.neutron [req-96021bdc-f98e-4a2d-8bd0-ecc8939d8a1a req-57790093-96be-4f32-aa08-226e47a3532f service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updating instance_info_cache with network_info: [{"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:34:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-96021bdc-f98e-4a2d-8bd0-ecc8939d8a1a req-57790093-96be-4f32-aa08-226e47a3532f service nova] Releasing lock "refresh_cache-2f5b57a9-5bac-4275-a51a-3213d7f9414f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6670e5b0-bcb1-4571-8610-86c2032eff08 tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:34:57 user nova-compute[75100]: INFO nova.compute.claims [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Claim successful on node user
Nov 13 17:34:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-f0f88549-ae0b-4373-b2a2-b12bf6560684 req-f995030b-d40a-4bdb-9bde-79ab91ab9ebf service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f0f88549-ae0b-4373-b2a2-b12bf6560684 req-f995030b-d40a-4bdb-9bde-79ab91ab9ebf service nova] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f0f88549-ae0b-4373-b2a2-b12bf6560684 req-f995030b-d40a-4bdb-9bde-79ab91ab9ebf service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f0f88549-ae0b-4373-b2a2-b12bf6560684 req-f995030b-d40a-4bdb-9bde-79ab91ab9ebf service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG nova.compute.manager [req-f0f88549-ae0b-4373-b2a2-b12bf6560684 req-f995030b-d40a-4bdb-9bde-79ab91ab9ebf service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] No waiting events found dispatching network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:34:57 user nova-compute[75100]: WARNING nova.compute.manager [req-f0f88549-ae0b-4373-b2a2-b12bf6560684 req-f995030b-d40a-4bdb-9bde-79ab91ab9ebf service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received unexpected event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 for instance with vm_state active and task_state None.
Nov 13 17:34:57 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:34:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:34:58 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:34:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG nova.policy [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15122cbfe21b4775b679285eeb4beff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43327ade8a814488bb141835e2ac331b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:34:58 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Creating image(s)
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "/opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "/opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "/opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk 1073741824" returned: 0 in 0.090s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:34:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:34:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:34:59 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Cannot resize image /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:34:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:34:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Ensure instance console log exists: /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:34:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:34:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:34:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:34:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Successfully created port: e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Successfully updated port: e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "refresh_cache-82968316-e313-4679-a853-f0d79e988c47" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquired lock "refresh_cache-82968316-e313-4679-a853-f0d79e988c47" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-d368291b-1a42-4364-a4ab-b52080970d01 req-68cead19-7686-449f-93db-21882f1b9113 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Received event network-changed-e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-d368291b-1a42-4364-a4ab-b52080970d01 req-68cead19-7686-449f-93db-21882f1b9113 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Refreshing instance network info cache due to event network-changed-e77bf7da-0b83-48f1-838a-67925d77322b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d368291b-1a42-4364-a4ab-b52080970d01 req-68cead19-7686-449f-93db-21882f1b9113 service nova] Acquiring lock "refresh_cache-82968316-e313-4679-a853-f0d79e988c47" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG nova.network.neutron [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Updating instance_info_cache with network_info: [{"id": "e77bf7da-0b83-48f1-838a-67925d77322b", "address": "fa:16:3e:e8:37:0e", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77bf7da-0b", "ovs_interfaceid": "e77bf7da-0b83-48f1-838a-67925d77322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Releasing lock "refresh_cache-82968316-e313-4679-a853-f0d79e988c47" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Instance network_info: |[{"id": "e77bf7da-0b83-48f1-838a-67925d77322b", "address": "fa:16:3e:e8:37:0e", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77bf7da-0b", "ovs_interfaceid": "e77bf7da-0b83-48f1-838a-67925d77322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d368291b-1a42-4364-a4ab-b52080970d01 req-68cead19-7686-449f-93db-21882f1b9113 service nova] Acquired lock "refresh_cache-82968316-e313-4679-a853-f0d79e988c47" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG nova.network.neutron [req-d368291b-1a42-4364-a4ab-b52080970d01 req-68cead19-7686-449f-93db-21882f1b9113 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Refreshing network info cache for port e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:35:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Start _get_guest_xml network_info=[{"id": "e77bf7da-0b83-48f1-838a-67925d77322b", "address": "fa:16:3e:e8:37:0e", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77bf7da-0b", "ovs_interfaceid": "e77bf7da-0b83-48f1-838a-67925d77322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:35:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:35:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:35:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1956930601',display_name='tempest-AttachVolumeTestJSON-server-1956930601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1956930601',id=34,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr7L08OoGFa+sLiQRS2XxgVJF5grMGztpgx7PiiwqjSErrvScLDXhKgglG1Dz/IkGbs/w230R6ZcEFWmJgbgwW2kleHRr0IcuaNskNbPH4MHAyYMPAcf6uNQAAC6Pk7mQ==',key_name='tempest-keypair-1784707078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43327ade8a814488bb141835e2ac331b',ramdisk_id='',reservation_id='r-3p8nqa6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2091682056',owner_user_name='tempest-AttachVolumeTestJSON-2091682056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15122cbfe21b4775b679285eeb4beff7',uuid=82968316-e313-4679-a853-f0d79e988c47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e77bf7da-0b83-48f1-838a-67925d77322b", "address": "fa:16:3e:e8:37:0e", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77bf7da-0b", "ovs_interfaceid": "e77bf7da-0b83-48f1-838a-67925d77322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converting VIF {"id": "e77bf7da-0b83-48f1-838a-67925d77322b", "address": "fa:16:3e:e8:37:0e", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77bf7da-0b", "ovs_interfaceid": "e77bf7da-0b83-48f1-838a-67925d77322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:37:0e,bridge_name='br-int',has_traffic_filtering=True,id=e77bf7da-0b83-48f1-838a-67925d77322b,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77bf7da-0b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.objects.instance [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'pci_devices' on Instance uuid 82968316-e313-4679-a853-f0d79e988c47 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:35:01 user nova-compute[75100]:   <uuid>82968316-e313-4679-a853-f0d79e988c47</uuid>
Nov 13 17:35:01 user nova-compute[75100]:   <name>instance-00000022</name>
Nov 13 17:35:01 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:35:01 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:35:01 user nova-compute[75100]:   <metadata>
Nov 13 17:35:01 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:35:01 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:35:01 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeTestJSON-server-1956930601</nova:name>
Nov 13 17:35:01 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:35:00</nova:creationTime>
Nov 13 17:35:01 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:35:01 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:35:01 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:35:01 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:35:01 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:35:01 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:35:01 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:35:01 user nova-compute[75100]:       <nova:owner>
Nov 13 17:35:01 user nova-compute[75100]:         <nova:user uuid="15122cbfe21b4775b679285eeb4beff7">tempest-AttachVolumeTestJSON-2091682056-project-member</nova:user>
Nov 13 17:35:01 user nova-compute[75100]:         <nova:project uuid="43327ade8a814488bb141835e2ac331b">tempest-AttachVolumeTestJSON-2091682056</nova:project>
Nov 13 17:35:01 user nova-compute[75100]:       </nova:owner>
Nov 13 17:35:01 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:35:01 user nova-compute[75100]:       <nova:ports>
Nov 13 17:35:01 user nova-compute[75100]:         <nova:port uuid="e77bf7da-0b83-48f1-838a-67925d77322b">
Nov 13 17:35:01 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 17:35:01 user nova-compute[75100]:         </nova:port>
Nov 13 17:35:01 user nova-compute[75100]:       </nova:ports>
Nov 13 17:35:01 user nova-compute[75100]:     </nova:instance>
Nov 13 17:35:01 user nova-compute[75100]:   </metadata>
Nov 13 17:35:01 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:35:01 user nova-compute[75100]:     <system>
Nov 13 17:35:01 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:35:01 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:35:01 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:35:01 user nova-compute[75100]:       <entry name="serial">82968316-e313-4679-a853-f0d79e988c47</entry>
Nov 13 17:35:01 user nova-compute[75100]:       <entry name="uuid">82968316-e313-4679-a853-f0d79e988c47</entry>
Nov 13 17:35:01 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:35:01 user nova-compute[75100]:     </system>
Nov 13 17:35:01 user nova-compute[75100]:   </sysinfo>
Nov 13 17:35:01 user nova-compute[75100]:   <os>
Nov 13 17:35:01 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:35:01 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:35:01 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:35:01 user nova-compute[75100]:   </os>
Nov 13 17:35:01 user nova-compute[75100]:   <features>
Nov 13 17:35:01 user nova-compute[75100]:     <acpi/>
Nov 13 17:35:01 user nova-compute[75100]:     <apic/>
Nov 13 17:35:01 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:35:01 user nova-compute[75100]:   </features>
Nov 13 17:35:01 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:35:01 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:35:01 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:35:01 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:35:01 user nova-compute[75100]:   </clock>
Nov 13 17:35:01 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:35:01 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:35:01 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:35:01 user nova-compute[75100]:   </cpu>
Nov 13 17:35:01 user nova-compute[75100]:   <devices>
Nov 13 17:35:01 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:35:01 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:35:01 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk"/>
Nov 13 17:35:01 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:35:01 user nova-compute[75100]:     </disk>
Nov 13 17:35:01 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:35:01 user nova-compute[75100]:       <mac address="fa:16:3e:e8:37:0e"/>
Nov 13 17:35:01 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:35:01 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:35:01 user nova-compute[75100]:       <target dev="tape77bf7da-0b"/>
Nov 13 17:35:01 user nova-compute[75100]:     </interface>
Nov 13 17:35:01 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:35:01 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/console.log" append="off"/>
Nov 13 17:35:01 user nova-compute[75100]:     </serial>
Nov 13 17:35:01 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:35:01 user nova-compute[75100]:     <video>
Nov 13 17:35:01 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:35:01 user nova-compute[75100]:     </video>
Nov 13 17:35:01 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:35:01 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:35:01 user nova-compute[75100]:     </rng>
Nov 13 17:35:01 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:35:01 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:35:01 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:35:01 user nova-compute[75100]:     </memballoon>
Nov 13 17:35:01 user nova-compute[75100]:   </devices>
Nov 13 17:35:01 user nova-compute[75100]: </domain>
Nov 13 17:35:01 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1956930601',display_name='tempest-AttachVolumeTestJSON-server-1956930601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1956930601',id=34,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr7L08OoGFa+sLiQRS2XxgVJF5grMGztpgx7PiiwqjSErrvScLDXhKgglG1Dz/IkGbs/w230R6ZcEFWmJgbgwW2kleHRr0IcuaNskNbPH4MHAyYMPAcf6uNQAAC6Pk7mQ==',key_name='tempest-keypair-1784707078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43327ade8a814488bb141835e2ac331b',ramdisk_id='',reservation_id='r-3p8nqa6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2091682056',owner_user_name='tempest-AttachVolumeTestJSON-2091682056-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15122cbfe21b4775b679285eeb4beff7',uuid=82968316-e313-4679-a853-f0d79e988c47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e77bf7da-0b83-48f1-838a-67925d77322b", "address": "fa:16:3e:e8:37:0e", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77bf7da-0b", "ovs_interfaceid": "e77bf7da-0b83-48f1-838a-67925d77322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converting VIF {"id": "e77bf7da-0b83-48f1-838a-67925d77322b", "address": "fa:16:3e:e8:37:0e", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77bf7da-0b", "ovs_interfaceid": "e77bf7da-0b83-48f1-838a-67925d77322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:37:0e,bridge_name='br-int',has_traffic_filtering=True,id=e77bf7da-0b83-48f1-838a-67925d77322b,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77bf7da-0b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG os_vif [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:37:0e,bridge_name='br-int',has_traffic_filtering=True,id=e77bf7da-0b83-48f1-838a-67925d77322b,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77bf7da-0b') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31b51ca8-a3f3-5a62-ab14-8669704650ab', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape77bf7da-0b, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape77bf7da-0b, col_values=(('qos', UUID('af378e21-8c85-4760-aead-3484c973f499')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape77bf7da-0b, col_values=(('external_ids', {'iface-id': 'e77bf7da-0b83-48f1-838a-67925d77322b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:37:0e', 'vm-uuid': '82968316-e313-4679-a853-f0d79e988c47'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:01 user nova-compute[75100]: INFO os_vif [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:37:0e,bridge_name='br-int',has_traffic_filtering=True,id=e77bf7da-0b83-48f1-838a-67925d77322b,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77bf7da-0b')
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No VIF found with MAC fa:16:3e:e8:37:0e, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-d368291b-1a42-4364-a4ab-b52080970d01 req-68cead19-7686-449f-93db-21882f1b9113 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Updated VIF entry in instance network info cache for port e77bf7da-0b83-48f1-838a-67925d77322b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-d368291b-1a42-4364-a4ab-b52080970d01 req-68cead19-7686-449f-93db-21882f1b9113 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Updating instance_info_cache with network_info: [{"id": "e77bf7da-0b83-48f1-838a-67925d77322b", "address": "fa:16:3e:e8:37:0e", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77bf7da-0b", "ovs_interfaceid": "e77bf7da-0b83-48f1-838a-67925d77322b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d368291b-1a42-4364-a4ab-b52080970d01 req-68cead19-7686-449f-93db-21882f1b9113 service nova] Releasing lock "refresh_cache-82968316-e313-4679-a853-f0d79e988c47" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-bdf4bc66-8611-4fda-8066-ff38cbd56566 req-25da887d-178c-46e0-b954-8f5d7dbb0c3f service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Received event network-vif-plugged-e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bdf4bc66-8611-4fda-8066-ff38cbd56566 req-25da887d-178c-46e0-b954-8f5d7dbb0c3f service nova] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bdf4bc66-8611-4fda-8066-ff38cbd56566 req-25da887d-178c-46e0-b954-8f5d7dbb0c3f service nova] Lock "82968316-e313-4679-a853-f0d79e988c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bdf4bc66-8611-4fda-8066-ff38cbd56566 req-25da887d-178c-46e0-b954-8f5d7dbb0c3f service nova] Lock "82968316-e313-4679-a853-f0d79e988c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-bdf4bc66-8611-4fda-8066-ff38cbd56566 req-25da887d-178c-46e0-b954-8f5d7dbb0c3f service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] No waiting events found dispatching network-vif-plugged-e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:02 user nova-compute[75100]: WARNING nova.compute.manager [req-bdf4bc66-8611-4fda-8066-ff38cbd56566 req-25da887d-178c-46e0-b954-8f5d7dbb0c3f service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Received unexpected event network-vif-plugged-e77bf7da-0b83-48f1-838a-67925d77322b for instance with vm_state building and task_state spawning.
Nov 13 17:35:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-c0443063-b80d-4768-a601-13e92ead79ea req-3b70a008-f416-4b66-9638-d14d281becfa service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Received event network-vif-plugged-e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c0443063-b80d-4768-a601-13e92ead79ea req-3b70a008-f416-4b66-9638-d14d281becfa service nova] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c0443063-b80d-4768-a601-13e92ead79ea req-3b70a008-f416-4b66-9638-d14d281becfa service nova] Lock "82968316-e313-4679-a853-f0d79e988c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c0443063-b80d-4768-a601-13e92ead79ea req-3b70a008-f416-4b66-9638-d14d281becfa service nova] Lock "82968316-e313-4679-a853-f0d79e988c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-c0443063-b80d-4768-a601-13e92ead79ea req-3b70a008-f416-4b66-9638-d14d281becfa service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] No waiting events found dispatching network-vif-plugged-e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:04 user nova-compute[75100]: WARNING nova.compute.manager [req-c0443063-b80d-4768-a601-13e92ead79ea req-3b70a008-f416-4b66-9638-d14d281becfa service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Received unexpected event network-vif-plugged-e77bf7da-0b83-48f1-838a-67925d77322b for instance with vm_state building and task_state spawning.
Nov 13 17:35:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:35:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:35:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 82968316-e313-4679-a853-f0d79e988c47] Instance spawned successfully.
Nov 13 17:35:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:35:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:35:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:35:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:35:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:35:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:35:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:35:05 user nova-compute[75100]: INFO nova.compute.manager [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 13 17:35:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:35:05 user nova-compute[75100]: INFO nova.compute.manager [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Took 7.68 seconds to build instance.
Nov 13 17:35:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-18f0c7d9-ba61-404e-acf4-db5056b3f781 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.778s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:06 user nova-compute[75100]: INFO nova.compute.manager [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Terminating instance
Nov 13 17:35:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Received event network-changed-5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Refreshing instance network info cache due to event network-changed-5a265285-9a4e-46b3-bd04-3b3f3608aaba. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] Acquiring lock "refresh_cache-6b7d6fb7-30cb-46bd-8ec9-11d60f160350" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] Acquired lock "refresh_cache-6b7d6fb7-30cb-46bd-8ec9-11d60f160350" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:06 user nova-compute[75100]: DEBUG nova.network.neutron [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Refreshing network info cache for port 5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Instance destroyed successfully.
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.objects.instance [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lazy-loading 'resources' on Instance uuid 6b7d6fb7-30cb-46bd-8ec9-11d60f160350 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:33:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1840907896',display_name='tempest-TestVolumeBootPattern-server-1840907896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1840907896',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+NtN2Z5kT0TQJbfKGQsJyKiPak8bepWgNcLUPGujC+AXoGWK840LLNYNacMdPigyvVLHhv89mM2IBFpbgvf3ZqImVEZSa6YyJUnBkkWfhyP+tfJPZtUfdOTGbNpjZ7sA==',key_name='tempest-TestVolumeBootPattern-2052596683',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:33:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-jefg57tu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:33:26Z,user_data=None,user_id='421484d1f180498fa5e078c084d70986',uuid=6b7d6fb7-30cb-46bd-8ec9-11d60f160350,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "address": "fa:16:3e:38:31:d4", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a265285-9a", "ovs_interfaceid": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "address": "fa:16:3e:38:31:d4", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a265285-9a", "ovs_interfaceid": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:31:d4,bridge_name='br-int',has_traffic_filtering=True,id=5a265285-9a4e-46b3-bd04-3b3f3608aaba,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a265285-9a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_vif [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:31:d4,bridge_name='br-int',has_traffic_filtering=True,id=5a265285-9a4e-46b3-bd04-3b3f3608aaba,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a265285-9a') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a265285-9a, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3afe2f3-209b-423c-b073-0e91a2443ca1) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:07 user nova-compute[75100]: INFO os_vif [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:31:d4,bridge_name='br-int',has_traffic_filtering=True,id=5a265285-9a4e-46b3-bd04-3b3f3608aaba,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a265285-9a')
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oySDifEA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:35:07 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a4aa0-48de-4922-b4f8-6c8001f4c197]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:35:07 user nova-compute[75100]: No targets found.
Nov 13 17:35:07 user nova-compute[75100]: iSNS:
Nov 13 17:35:07 user nova-compute[75100]: No targets found.
Nov 13 17:35:07 user nova-compute[75100]: STATIC:
Nov 13 17:35:07 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:35:07 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:07 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:07 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c
Nov 13 17:35:07 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:07 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:07 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22
Nov 13 17:35:07 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:07 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:07 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da
Nov 13 17:35:07 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:07 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:07 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:35:07 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:07 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:07 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2
Nov 13 17:35:07 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:07 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:07 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:35:07 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:07 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:07 user nova-compute[75100]: FIRMWARE:
Nov 13 17:35:07 user nova-compute[75100]: No targets found.
Nov 13 17:35:07 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:35:07 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:35:07 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6f8173-cc1a-4f08-9967-69233c97af56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83d8e3d-f455-46aa-bf0f-927dfe6e2c74]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:07 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:07 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:07 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:07 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:07 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:35:07 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:07 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:07 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:07 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:07 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:07 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:07 user nova-compute[75100]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c (non-flash)
Nov 13 17:35:07 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:07 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c4c30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c'): ({'sdi'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Removing single pathed devices sdi {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfe6c65-062a-451b-8a1f-1c3ba761030e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81b4d67-9dae-4a6d-a70a-cc625656aa47]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flushing IO for device /dev/sdi {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[574c3c07-ea0d-4136-8db6-212efea8868b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.network.neutron [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Updated VIF entry in instance network info cache for port 5a265285-9a4e-46b3-bd04-3b3f3608aaba. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.network.neutron [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Updating instance_info_cache with network_info: [{"id": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "address": "fa:16:3e:38:31:d4", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a265285-9a", "ovs_interfaceid": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[471aa9f3-0bfc-4905-867a-24f4545f327c]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] SCSI volumes sdi have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b7829f0f', '/dev/disk/by-id/scsi-1SCST_BIOb7829f0f-0380e9728dc5c2b8', '/dev/disk/by-id/scsi-23033383065393732') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e25540b-c767-4bd3-8e03-a05f31fa1447]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] Releasing lock "refresh_cache-6b7d6fb7-30cb-46bd-8ec9-11d60f160350" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Received event network-changed-5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Refreshing instance network info cache due to event network-changed-5a265285-9a4e-46b3-bd04-3b3f3608aaba. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] Acquiring lock "refresh_cache-6b7d6fb7-30cb-46bd-8ec9-11d60f160350" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] Acquired lock "refresh_cache-6b7d6fb7-30cb-46bd-8ec9-11d60f160350" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.network.neutron [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Refreshing network info cache for port 5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-15416c6c-4b6a-475f-8d9b-bd67d46018d2 req-5ead80e9-f0ea-49c3-b21f-1389f8e70560 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Received event network-vif-unplugged-5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-15416c6c-4b6a-475f-8d9b-bd67d46018d2 req-5ead80e9-f0ea-49c3-b21f-1389f8e70560 service nova] Acquiring lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-15416c6c-4b6a-475f-8d9b-bd67d46018d2 req-5ead80e9-f0ea-49c3-b21f-1389f8e70560 service nova] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-15416c6c-4b6a-475f-8d9b-bd67d46018d2 req-5ead80e9-f0ea-49c3-b21f-1389f8e70560 service nova] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-15416c6c-4b6a-475f-8d9b-bd67d46018d2 req-5ead80e9-f0ea-49c3-b21f-1389f8e70560 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] No waiting events found dispatching network-vif-unplugged-5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-15416c6c-4b6a-475f-8d9b-bd67d46018d2 req-5ead80e9-f0ea-49c3-b21f-1389f8e70560 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Received event network-vif-unplugged-5a265285-9a4e-46b3-bd04-3b3f3608aaba for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d591342-6ca4-44dd-8117-7ccf6412fe8b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea2dbcb-ec52-4f61-9db3-d1a4cf6c47a3]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c, portal: 172.16.0.220,3260]
Nov 13 17:35:07 user nova-compute[75100]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c, portal: 172.16.0.220,3260] successful.
Nov 13 17:35:07 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:07 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:08 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:973314de-8205-4322-91eb-a9566496a56c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:08 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d772b797-b750-4971-8f8b-5ad046a45c12]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:35:08 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== disconnect_volume: return (422ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:35:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:35:08 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Deleting instance files /opt/stack/data/nova/instances/6b7d6fb7-30cb-46bd-8ec9-11d60f160350_del
Nov 13 17:35:08 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Deletion of /opt/stack/data/nova/instances/6b7d6fb7-30cb-46bd-8ec9-11d60f160350_del complete
Nov 13 17:35:08 user nova-compute[75100]: INFO nova.compute.manager [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 13 17:35:08 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:35:08 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:35:08 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:35:08 user nova-compute[75100]: DEBUG nova.network.neutron [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Updated VIF entry in instance network info cache for port 5a265285-9a4e-46b3-bd04-3b3f3608aaba. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:35:08 user nova-compute[75100]: DEBUG nova.network.neutron [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Updating instance_info_cache with network_info: [{"id": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "address": "fa:16:3e:38:31:d4", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a265285-9a", "ovs_interfaceid": "5a265285-9a4e-46b3-bd04-3b3f3608aaba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fdfd99f6-a8d7-4417-b13e-a70bfc972ff3 req-1cae7662-cba5-4d82-a2a3-f995007bdc38 service nova] Releasing lock "refresh_cache-6b7d6fb7-30cb-46bd-8ec9-11d60f160350" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:08 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:08 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Took 0.80 seconds to deallocate network for instance.
Nov 13 17:35:09 user nova-compute[75100]: INFO nova.compute.manager [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Took 1.00 seconds to detach 1 volumes for instance.
Nov 13 17:35:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-ff178e31-afff-43d0-aa38-70d641043908 req-2d458b4c-30b4-4c8f-a349-2a766c7ebefa service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Received event network-vif-plugged-5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff178e31-afff-43d0-aa38-70d641043908 req-2d458b4c-30b4-4c8f-a349-2a766c7ebefa service nova] Acquiring lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff178e31-afff-43d0-aa38-70d641043908 req-2d458b4c-30b4-4c8f-a349-2a766c7ebefa service nova] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ff178e31-afff-43d0-aa38-70d641043908 req-2d458b4c-30b4-4c8f-a349-2a766c7ebefa service nova] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-ff178e31-afff-43d0-aa38-70d641043908 req-2d458b4c-30b4-4c8f-a349-2a766c7ebefa service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] No waiting events found dispatching network-vif-plugged-5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:09 user nova-compute[75100]: WARNING nova.compute.manager [req-ff178e31-afff-43d0-aa38-70d641043908 req-2d458b4c-30b4-4c8f-a349-2a766c7ebefa service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Received unexpected event network-vif-plugged-5a265285-9a4e-46b3-bd04-3b3f3608aaba for instance with vm_state active and task_state deleting.
Nov 13 17:35:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-ff178e31-afff-43d0-aa38-70d641043908 req-2d458b4c-30b4-4c8f-a349-2a766c7ebefa service nova] [instance: 6b7d6fb7-30cb-46bd-8ec9-11d60f160350] Received event network-vif-deleted-5a265285-9a4e-46b3-bd04-3b3f3608aaba {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:10 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:35:10 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:35:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:10 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Deleted allocations for instance 6b7d6fb7-30cb-46bd-8ec9-11d60f160350
Nov 13 17:35:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-aa316147-ed36-4d32-ae1b-dcd09abec8cb tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "6b7d6fb7-30cb-46bd-8ec9-11d60f160350" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.944s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:35:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:35:15 user nova-compute[75100]: INFO nova.compute.claims [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Claim successful on node user
Nov 13 17:35:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:35:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:35:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:35:16 user nova-compute[75100]: INFO nova.virt.block_device [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Booting with volume 00cceb1b-0a2d-4836-b40c-e359125647e1 at /dev/vda
Nov 13 17:35:16 user nova-compute[75100]: DEBUG os_brick.utils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d074425c-94e5-4b7c-adb9-98f19c8af7c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c556996-cab9-4cd6-9aa6-83ba208694df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[05410030-a476-4dd3-a2a0-d57a38c6f31b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[642372d3-e6ae-4f37-8eb1-58f13c5535b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG nova.policy [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4316b59045e5428a855d54bed24c5170', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1590c0bc0e2d44f89729b0ae32904fcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:35:16 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:35:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e9c0f5-1001-4eed-9941-1f49b6b17cbd]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG os_brick.utils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:35:16 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating existing volume attachment record: f1b71c73-3594-4d65-942f-17fda18742fc {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:35:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Successfully created port: ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:35:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Successfully created port: 94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:35:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Successfully created port: 1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:35:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Successfully created port: cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:35:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Successfully created port: 9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:35:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Successfully updated port: ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:35:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-6536ed23-d9c3-4637-8f6f-6d4e6a6ee708 req-98c22be4-df31-48ba-83f5-180bb85c28af service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-changed-ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-6536ed23-d9c3-4637-8f6f-6d4e6a6ee708 req-98c22be4-df31-48ba-83f5-180bb85c28af service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing instance network info cache due to event network-changed-ff6ba9bf-a2e8-410f-aff9-0820512938f0. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:35:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6536ed23-d9c3-4637-8f6f-6d4e6a6ee708 req-98c22be4-df31-48ba-83f5-180bb85c28af service nova] Acquiring lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6536ed23-d9c3-4637-8f6f-6d4e6a6ee708 req-98c22be4-df31-48ba-83f5-180bb85c28af service nova] Acquired lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-6536ed23-d9c3-4637-8f6f-6d4e6a6ee708 req-98c22be4-df31-48ba-83f5-180bb85c28af service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing network info cache for port ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:35:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-6536ed23-d9c3-4637-8f6f-6d4e6a6ee708 req-98c22be4-df31-48ba-83f5-180bb85c28af service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:35:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-6536ed23-d9c3-4637-8f6f-6d4e6a6ee708 req-98c22be4-df31-48ba-83f5-180bb85c28af service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6536ed23-d9c3-4637-8f6f-6d4e6a6ee708 req-98c22be4-df31-48ba-83f5-180bb85c28af service nova] Releasing lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:21 user nova-compute[75100]: INFO nova.virt.block_device [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Booting with volume 88050523-c59a-49b7-89d3-c38ba0052fd0 at /dev/vdb
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:21 user nova-compute[75100]: INFO nova.compute.manager [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Terminating instance
Nov 13 17:35:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG os_brick.utils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcefb14-fe68-4fb5-b5de-9ddc569d86a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[741cb355-4fc2-4bb7-bda5-6e3ac0d00a00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dec4ab1-25f2-48d3-be4e-cea16d50410f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd1e770-a3df-4a5a-a177-4687a5770a03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:35:21 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[021e781b-5cff-4e4d-96aa-f04fcccf602b]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG os_brick.utils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating existing volume attachment record: 8af94856-4340-4f57-97e6-2ed78ee75c4b {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-b8fabd55-a525-4e9e-91f5-d0a4160f5896 req-0fca0da5-c988-4bde-a662-db08f5c952ed service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received event network-vif-unplugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b8fabd55-a525-4e9e-91f5-d0a4160f5896 req-0fca0da5-c988-4bde-a662-db08f5c952ed service nova] Acquiring lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b8fabd55-a525-4e9e-91f5-d0a4160f5896 req-0fca0da5-c988-4bde-a662-db08f5c952ed service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b8fabd55-a525-4e9e-91f5-d0a4160f5896 req-0fca0da5-c988-4bde-a662-db08f5c952ed service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-b8fabd55-a525-4e9e-91f5-d0a4160f5896 req-0fca0da5-c988-4bde-a662-db08f5c952ed service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] No waiting events found dispatching network-vif-unplugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-b8fabd55-a525-4e9e-91f5-d0a4160f5896 req-0fca0da5-c988-4bde-a662-db08f5c952ed service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received event network-vif-unplugged-daca5488-cacc-44a2-9798-4da784566bad for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Successfully updated port: 0834a216-c9af-4a33-bcdf-3c214e52e109 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Instance destroyed successfully.
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'resources' on Instance uuid 7f3f3c5b-5128-4356-a995-fe3265f49fe1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1848893497',display_name='tempest-ServerRescueNegativeTestJSON-server-1848893497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1848893497',id=3,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:21:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6c1d1cfd844465e85239be73eb73cec',ramdisk_id='',reservation_id='r-xeiyvn89',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1273984533',owner_user_name='tempest-ServerRescueNegativeTestJSON-1273984533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:21:20Z,user_data=None,user_id='33657093c7ab4112994a1b7e997cfb34',uuid=7f3f3c5b-5128-4356-a995-fe3265f49fe1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converting VIF {"id": "daca5488-cacc-44a2-9798-4da784566bad", "address": "fa:16:3e:85:dc:26", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaca5488-ca", "ovs_interfaceid": "daca5488-cacc-44a2-9798-4da784566bad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=daca5488-cacc-44a2-9798-4da784566bad,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaca5488-ca') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG os_vif [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=daca5488-cacc-44a2-9798-4da784566bad,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaca5488-ca') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaca5488-ca, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=353e39ed-85bf-4eb3-8923-4c0b81072ae6) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:22 user nova-compute[75100]: INFO os_vif [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:dc:26,bridge_name='br-int',has_traffic_filtering=True,id=daca5488-cacc-44a2-9798-4da784566bad,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaca5488-ca')
Nov 13 17:35:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Deleting instance files /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1_del
Nov 13 17:35:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Deletion of /opt/stack/data/nova/instances/7f3f3c5b-5128-4356-a995-fe3265f49fe1_del complete
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-00dde2f6-9f58-444c-a7bf-00231506cf19 req-f636bf53-8952-4f0f-9fde-6189a8ef649e service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-changed-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-00dde2f6-9f58-444c-a7bf-00231506cf19 req-f636bf53-8952-4f0f-9fde-6189a8ef649e service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Refreshing instance network info cache due to event network-changed-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-00dde2f6-9f58-444c-a7bf-00231506cf19 req-f636bf53-8952-4f0f-9fde-6189a8ef649e service nova] Acquiring lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-00dde2f6-9f58-444c-a7bf-00231506cf19 req-f636bf53-8952-4f0f-9fde-6189a8ef649e service nova] Acquired lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-00dde2f6-9f58-444c-a7bf-00231506cf19 req-f636bf53-8952-4f0f-9fde-6189a8ef649e service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Refreshing network info cache for port 3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:35:22 user nova-compute[75100]: INFO nova.compute.manager [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 13 17:35:22 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Successfully updated port: 3849db2d-8539-4a60-a828-f0167e4ffd8e {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-4bcb98ef-3e5f-43f2-964b-b008b80d8ea7 req-c661e3b0-b806-4f43-872f-d8f3f5e83030 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-changed-0834a216-c9af-4a33-bcdf-3c214e52e109 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-4bcb98ef-3e5f-43f2-964b-b008b80d8ea7 req-c661e3b0-b806-4f43-872f-d8f3f5e83030 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing instance network info cache due to event network-changed-0834a216-c9af-4a33-bcdf-3c214e52e109. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4bcb98ef-3e5f-43f2-964b-b008b80d8ea7 req-c661e3b0-b806-4f43-872f-d8f3f5e83030 service nova] Acquiring lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4bcb98ef-3e5f-43f2-964b-b008b80d8ea7 req-c661e3b0-b806-4f43-872f-d8f3f5e83030 service nova] Acquired lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-4bcb98ef-3e5f-43f2-964b-b008b80d8ea7 req-c661e3b0-b806-4f43-872f-d8f3f5e83030 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing network info cache for port 0834a216-c9af-4a33-bcdf-3c214e52e109 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.network.neutron [req-4bcb98ef-3e5f-43f2-964b-b008b80d8ea7 req-c661e3b0-b806-4f43-872f-d8f3f5e83030 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:22 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Took 0.42 seconds to deallocate network for instance.
Nov 13 17:35:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-4bcb98ef-3e5f-43f2-964b-b008b80d8ea7 req-c661e3b0-b806-4f43-872f-d8f3f5e83030 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4bcb98ef-3e5f-43f2-964b-b008b80d8ea7 req-c661e3b0-b806-4f43-872f-d8f3f5e83030 service nova] Releasing lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.488s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-00dde2f6-9f58-444c-a7bf-00231506cf19 req-f636bf53-8952-4f0f-9fde-6189a8ef649e service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updated VIF entry in instance network info cache for port 3f5b2945-ec9f-48e7-ada2-3c0cce2f8271. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-00dde2f6-9f58-444c-a7bf-00231506cf19 req-f636bf53-8952-4f0f-9fde-6189a8ef649e service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updating instance_info_cache with network_info: [{"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:23 user nova-compute[75100]: INFO nova.compute.manager [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Detaching volume 9deacb14-d81b-46e6-9701-ec9ce76ebab2
Nov 13 17:35:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-00dde2f6-9f58-444c-a7bf-00231506cf19 req-f636bf53-8952-4f0f-9fde-6189a8ef649e service nova] Releasing lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:23 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Deleted allocations for instance 7f3f3c5b-5128-4356-a995-fe3265f49fe1
Nov 13 17:35:23 user nova-compute[75100]: INFO nova.virt.block_device [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Attempting to driver detach volume 9deacb14-d81b-46e6-9701-ec9ce76ebab2 from mountpoint /dev/vdb
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Attempting to detach device vdb from instance a5f308a2-3b44-476e-85ab-15e1bf107968 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:35:23 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:35:23 user nova-compute[75100]:   <source dev="/dev/sdh"/>
Nov 13 17:35:23 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:35:23 user nova-compute[75100]:   <serial>9deacb14-d81b-46e6-9701-ec9ce76ebab2</serial>
Nov 13 17:35:23 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 17:35:23 user nova-compute[75100]: </disk>
Nov 13 17:35:23 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:35:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Successfully detached device vdb from instance a5f308a2-3b44-476e-85ab-15e1bf107968 from the persistent domain config.
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5f308a2-3b44-476e-85ab-15e1bf107968 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:35:23 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:35:23 user nova-compute[75100]:   <source dev="/dev/sdh"/>
Nov 13 17:35:23 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:35:23 user nova-compute[75100]:   <serial>9deacb14-d81b-46e6-9701-ec9ce76ebab2</serial>
Nov 13 17:35:23 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 17:35:23 user nova-compute[75100]: </disk>
Nov 13 17:35:23 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f5b46f82-f32b-428a-a2a5-1b0c34472a33 tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.079s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received event network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] Acquiring lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] Lock "7f3f3c5b-5128-4356-a995-fe3265f49fe1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] No waiting events found dispatching network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:23 user nova-compute[75100]: WARNING nova.compute.manager [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received unexpected event network-vif-plugged-daca5488-cacc-44a2-9798-4da784566bad for instance with vm_state deleted and task_state None.
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-changed-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Refreshing instance network info cache due to event network-changed-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] Acquiring lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] Acquired lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Refreshing network info cache for port 3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Successfully updated port: 94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:35:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5f308a2-3b44-476e-85ab-15e1bf107968 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:35:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updated VIF entry in instance network info cache for port 3f5b2945-ec9f-48e7-ada2-3c0cce2f8271. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:35:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updating instance_info_cache with network_info: [{"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-84a30ba4-2ea0-4040-ab22-fa226142ece0 req-d7596d0a-b23d-41a8-be28-430b42112a9b service nova] Releasing lock "refresh_cache-a5f308a2-3b44-476e-85ab-15e1bf107968" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-44f1154d-3602-4802-b9f1-0a35a0eb0969 req-e529fe9e-448a-4a26-96e9-9e46b2d229f9 service nova] [instance: 7f3f3c5b-5128-4356-a995-fe3265f49fe1] Received event network-vif-deleted-daca5488-cacc-44a2-9798-4da784566bad {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Successfully updated port: 1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:35:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-changed-3849db2d-8539-4a60-a828-f0167e4ffd8e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing instance network info cache due to event network-changed-3849db2d-8539-4a60-a828-f0167e4ffd8e. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:35:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] Acquiring lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] Acquired lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing network info cache for port 3849db2d-8539-4a60-a828-f0167e4ffd8e {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:35:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] Releasing lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-changed-94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing instance network info cache due to event network-changed-94abc659-a0f6-42ce-815c-5aea10c1d2d9. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] Acquiring lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] Acquired lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing network info cache for port 94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:25 user nova-compute[75100]: INFO nova.compute.manager [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Detaching volume 58db2acc-e6cc-45d7-990d-8eb67b54f4da
Nov 13 17:35:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4ab6db10-9e92-4cd4-8cb1-fe5668e9b252 req-70842998-7251-40f1-ad61-9f0c0b3b69ed service nova] Releasing lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:25 user nova-compute[75100]: INFO nova.virt.block_device [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Attempting to driver detach volume 58db2acc-e6cc-45d7-990d-8eb67b54f4da from mountpoint /dev/vdb
Nov 13 17:35:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Attempting to detach device vdb from instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:35:25 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:35:25 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:35:25 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:35:25 user nova-compute[75100]:   <serial>58db2acc-e6cc-45d7-990d-8eb67b54f4da</serial>
Nov 13 17:35:25 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:35:25 user nova-compute[75100]: </disk>
Nov 13 17:35:25 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:35:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Successfully detached device vdb from instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f from the persistent domain config.
Nov 13 17:35:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:35:25 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:35:25 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:35:25 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:35:25 user nova-compute[75100]:   <serial>58db2acc-e6cc-45d7-990d-8eb67b54f4da</serial>
Nov 13 17:35:25 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:35:25 user nova-compute[75100]: </disk>
Nov 13 17:35:25 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Successfully updated port: cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:35:25 user nova-compute[75100]: INFO nova.virt.block_device [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Booting with volume 5681a9a0-98bd-4070-9682-8dd09420364d at /dev/vdc
Nov 13 17:35:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG os_brick.utils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1f7493-debc-4850-9199-82533e6d04ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cfc9ec-c310-4050-be3c-01fd50e66c03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2d40ed-becf-43c4-bc4d-736339a15b68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[121a10ac-8853-4553-a519-491901cebfb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:35:26 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:35:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea96013c-ede6-4c58-87ea-8ee4cff9dd73]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG os_brick.utils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating existing volume attachment record: 221bb1ec-589e-40fe-8f01-a683a69f5914 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Successfully updated port: 9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquired lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-changed-1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing instance network info cache due to event network-changed-1d615688-8ac5-49d1-8497-d846c7cd21b6. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:35:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] Acquiring lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [{"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Releasing lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Instance network_info: |[{"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] Acquired lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing network info cache for port 1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updated VIF entry in instance network info cache for port 1d615688-8ac5-49d1-8497-d846c7cd21b6. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [{"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] Releasing lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-changed-cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing instance network info cache due to event network-changed-cbd8d867-99b0-467a-90e5-8f987740ad12. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] Acquiring lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] Acquired lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing network info cache for port cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updated VIF entry in instance network info cache for port cbd8d867-99b0-467a-90e5-8f987740ad12. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [{"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] Releasing lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-changed-9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing instance network info cache due to event network-changed-9063a069-2e42-4058-8355-98ab31c555f1. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] Acquiring lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] Acquired lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing network info cache for port 9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updated VIF entry in instance network info cache for port 9063a069-2e42-4058-8355-98ab31c555f1. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [{"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a1af884-de9a-47a2-a027-31a520a5c71b req-66d9e4f2-49ae-49d7-aa63-3779893c1403 service nova] Releasing lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:35:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Creating image(s)
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Ensure instance console log exists: /opt/stack/data/nova/instances/640d6233-140a-4bf0-8155-c309e75cfc1b/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Start _get_guest_xml network_info=[{"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'f1b71c73-3594-4d65-942f-17fda18742fc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiycsATw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '640d6233-140a-4bf0-8155-c309e75cfc1b', 'attached_at': '', 'detached_at': '', 'volume_id': '00cceb1b-0a2d-4836-b40c-e359125647e1', 'serial': '00cceb1b-0a2d-4836-b40c-e359125647e1'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '8af94856-4340-4f57-97e6-2ed78ee75c4b', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKhxDOsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '640d6233-140a-4bf0-8155-c309e75cfc1b', 'attached_at': '', 'detached_at': '', 'volume_id': '88050523-c59a-49b7-89d3-c38ba0052fd0', 'serial': '88050523-c59a-49b7-89d3-c38ba0052fd0'}, 'device_type': 'disk', 'boot_index': 1, 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '221bb1ec-589e-40fe-8f01-a683a69f5914', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VScYOXvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '640d6233-140a-4bf0-8155-c309e75cfc1b', 'attached_at': '', 'detached_at': '', 'volume_id': '5681a9a0-98bd-4070-9682-8dd09420364d', 'serial': '5681a9a0-98bd-4070-9682-8dd09420364d'}, 'device_type': 'disk', 'boot_index': 2, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:35:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:35:30 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiycsATw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:35:30 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:35:30 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:35:30 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c8e533-ea4e-40fe-a928-7153390c9a4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:35:30 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88ae0db-aad9-45db-8d98-0482ac851ed7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1] added
Nov 13 17:35:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ceece68-6c34-497d-b832-a51e07ebd555]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b3a1fb-bb60-4309-83bb-3c45de73622f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XiycsATw {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XiycsATw" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daab41e-edbc-49b1-b604-48edb9dcdca3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XiycsATw'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f26f622-f649-48c6-88ec-3f393fd28854]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d33b215-5222-4094-89c2-dd203fdc150f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6546e89-9573-4b0f-93a7-89bc1daa2d56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1, portal: 172.16.0.220,3260]
Nov 13 17:35:30 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1, portal: 172.16.0.220,3260] successful.
Nov 13 17:35:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6281cc1-0479-457c-9dac-a92c57c876af]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7f8832-c43c-4f55-a5b2-5eb91a9a9fdc]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[294301e1-dc11-4445-8d8f-e6660d51f3a6]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:35:31 user nova-compute[75100]: INFO nova.compute.manager [None req-7fa8215f-2c3f-475c-8661-1fe312c0a174 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Unrescuing
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7fa8215f-2c3f-475c-8661-1fe312c0a174 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "refresh_cache-3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7fa8215f-2c3f-475c-8661-1fe312c0a174 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquired lock "refresh_cache-3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7fa8215f-2c3f-475c-8661-1fe312c0a174 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-7fa8215f-2c3f-475c-8661-1fe312c0a174 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Updating instance_info_cache with network_info: [{"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7fa8215f-2c3f-475c-8661-1fe312c0a174 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Releasing lock "refresh_cache-3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7fa8215f-2c3f-475c-8661-1fe312c0a174 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'flavor' on Instance uuid 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiycsATw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23134393663323234', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134393663323234', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKhxDOsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:35:31 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:35:31 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:35:31 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5872f057-d975-41ad-b499-22422e3106e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:35:31 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b3976c-252e-440a-9600-ec338299cbab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0] added
Nov 13 17:35:31 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1e9b81-4997-4d83-a728-01722342cbdc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4c1276-4170-4bf7-9294-d48bc609d807]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKhxDOsu {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKhxDOsu" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f1654a-c151-4a86-9f96-4d1454a57af0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XKhxDOsu'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-0898fd11-b3bf-4fd0-8f65-c9ba98527356 req-a93d6bb2-fbba-4789-b88b-7a573e20bfe0 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-unplugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0898fd11-b3bf-4fd0-8f65-c9ba98527356 req-a93d6bb2-fbba-4789-b88b-7a573e20bfe0 service nova] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0898fd11-b3bf-4fd0-8f65-c9ba98527356 req-a93d6bb2-fbba-4789-b88b-7a573e20bfe0 service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0898fd11-b3bf-4fd0-8f65-c9ba98527356 req-a93d6bb2-fbba-4789-b88b-7a573e20bfe0 service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-0898fd11-b3bf-4fd0-8f65-c9ba98527356 req-a93d6bb2-fbba-4789-b88b-7a573e20bfe0 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] No waiting events found dispatching network-vif-unplugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:31 user nova-compute[75100]: WARNING nova.compute.manager [req-0898fd11-b3bf-4fd0-8f65-c9ba98527356 req-a93d6bb2-fbba-4789-b88b-7a573e20bfe0 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received unexpected event network-vif-unplugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c049a96-a35c-49df-8cec-04f63c686546]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ad3f35-0fa7-4f46-ba3d-fd2c218bc426]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:31 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:31 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:31 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:31 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:31 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:31 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:31 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:31 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:31 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:31 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:31 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:31 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:31 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:31 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:31 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[37323821-bf15-4c4b-a608-75f469202281]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0, portal: 172.16.0.220,3260]
Nov 13 17:35:32 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0, portal: 172.16.0.220,3260] successful.
Nov 13 17:35:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b3db3-8abd-45af-b8a6-bac57ac141b4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0f8a64-aa8f-4cec-b1e8-34d9a9cbda33]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:35:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:32 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:35:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] HCTL ('40', '-', '-', 0) found on session 43 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[771a3530-b595-478b-b0b4-a6f009378df8]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Searching for a device in session 43 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKhxDOsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Instance destroyed successfully.
Nov 13 17:35:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '23666356563626636', 'path': '/dev/sdi'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666356563626636', 'path': '/dev/sdi'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VScYOXvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:35:33 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:35:33 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:35:33 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f5e0d1-87ea-4e1e-aa3c-d343316a06d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:35:33 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f29157-6d58-459e-8084-19a6a01767e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d] added
Nov 13 17:35:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[106ec5bc-ba6d-4da4-8682-90d71d663729]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[130d0af0-2ca3-45b5-adae-b02fd44836b7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VScYOXvk {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VScYOXvk" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b3a761-2e43-4c70-a192-994cd48f81bd]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VScYOXvk'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[be172a1d-eb98-4c7a-ba49-aa1c87d6fae8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bf074a-057a-469d-a06b-f5e34731620b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea79bee4-8d92-4b4d-a814-60c972da43a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d, portal: 172.16.0.220,3260]
Nov 13 17:35:33 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d, portal: 172.16.0.220,3260] successful.
Nov 13 17:35:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd7ffc5-74cd-4183-ab8a-42d4026479b8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe85409-647a-4979-b7ee-212a3700ed31]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:35:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:35:33 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:35:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] HCTL ('41', '-', '-', 0) found on session 44 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab987e1-8dd6-4022-9800-478316b38eb3]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Searching for a device in session 44 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VScYOXvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-8aca37ad-ca0a-4a18-bcc7-295b2d3e2872 req-2bff5d28-6d76-477b-8c6c-f79fbbdffd5d service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8aca37ad-ca0a-4a18-bcc7-295b2d3e2872 req-2bff5d28-6d76-477b-8c6c-f79fbbdffd5d service nova] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8aca37ad-ca0a-4a18-bcc7-295b2d3e2872 req-2bff5d28-6d76-477b-8c6c-f79fbbdffd5d service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8aca37ad-ca0a-4a18-bcc7-295b2d3e2872 req-2bff5d28-6d76-477b-8c6c-f79fbbdffd5d service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-8aca37ad-ca0a-4a18-bcc7-295b2d3e2872 req-2bff5d28-6d76-477b-8c6c-f79fbbdffd5d service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] No waiting events found dispatching network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:33 user nova-compute[75100]: WARNING nova.compute.manager [req-8aca37ad-ca0a-4a18-bcc7-295b2d3e2872 req-2bff5d28-6d76-477b-8c6c-f79fbbdffd5d service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received unexpected event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:35:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-8aca37ad-ca0a-4a18-bcc7-295b2d3e2872 req-2bff5d28-6d76-477b-8c6c-f79fbbdffd5d service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8aca37ad-ca0a-4a18-bcc7-295b2d3e2872 req-2bff5d28-6d76-477b-8c6c-f79fbbdffd5d service nova] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8aca37ad-ca0a-4a18-bcc7-295b2d3e2872 req-2bff5d28-6d76-477b-8c6c-f79fbbdffd5d service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8aca37ad-ca0a-4a18-bcc7-295b2d3e2872 req-2bff5d28-6d76-477b-8c6c-f79fbbdffd5d service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-8aca37ad-ca0a-4a18-bcc7-295b2d3e2872 req-2bff5d28-6d76-477b-8c6c-f79fbbdffd5d service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] No waiting events found dispatching network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:33 user nova-compute[75100]: WARNING nova.compute.manager [req-8aca37ad-ca0a-4a18-bcc7-295b2d3e2872 req-2bff5d28-6d76-477b-8c6c-f79fbbdffd5d service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received unexpected event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 for instance with vm_state rescued and task_state unrescuing.
Nov 13 17:35:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26133373363653230', 'path': '/dev/sdj'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133373363653230', 'path': '/dev/sdj'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:09:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff6ba9bf-a2e8-410f-aff9-0820512938f0,network=Network(55829031-6f7b-434b-9a1a-5098c061235a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6ba9bf-a2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:8d:54,bridge_name='br-int',has_traffic_filtering=True,id=0834a216-c9af-4a33-bcdf-3c214e52e109,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0834a216-c9') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:49:a3,bridge_name='br-int',has_traffic_filtering=True,id=3849db2d-8539-4a60-a828-f0167e4ffd8e,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3849db2d-85') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:4c:d9,bridge_name='br-int',has_traffic_filtering=True,id=94abc659-a0f6-42ce-815c-5aea10c1d2d9,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc659-a0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b5:77,bridge_name='br-int',has_traffic_filtering=True,id=1d615688-8ac5-49d1-8497-d846c7cd21b6,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d615688-8a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:df:01,bridge_name='br-int',has_traffic_filtering=True,id=cbd8d867-99b0-467a-90e5-8f987740ad12,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd8d867-99') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:92:c6,bridge_name='br-int',has_traffic_filtering=True,id=9063a069-2e42-4058-8355-98ab31c555f1,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9063a069-2e') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lazy-loading 'pci_devices' on Instance uuid 640d6233-140a-4bf0-8155-c309e75cfc1b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:35:34 user nova-compute[75100]:   <uuid>640d6233-140a-4bf0-8155-c309e75cfc1b</uuid>
Nov 13 17:35:34 user nova-compute[75100]:   <name>instance-00000023</name>
Nov 13 17:35:34 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:35:34 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:35:34 user nova-compute[75100]:   <metadata>
Nov 13 17:35:34 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:35:34 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:35:34 user nova-compute[75100]:       <nova:name>tempest-device-tagging-server-663101775</nova:name>
Nov 13 17:35:34 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:35:30</nova:creationTime>
Nov 13 17:35:34 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:35:34 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:35:34 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:35:34 user nova-compute[75100]:       <nova:owner>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:user uuid="4316b59045e5428a855d54bed24c5170">tempest-TaggedBootDevicesTest_v242-1067443993-project-member</nova:user>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:project uuid="1590c0bc0e2d44f89729b0ae32904fcd">tempest-TaggedBootDevicesTest_v242-1067443993</nova:project>
Nov 13 17:35:34 user nova-compute[75100]:       </nova:owner>
Nov 13 17:35:34 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:35:34 user nova-compute[75100]:       <nova:ports>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:port uuid="ff6ba9bf-a2e8-410f-aff9-0820512938f0">
Nov 13 17:35:34 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 17:35:34 user nova-compute[75100]:         </nova:port>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:port uuid="0834a216-c9af-4a33-bcdf-3c214e52e109">
Nov 13 17:35:34 user nova-compute[75100]:           <nova:ip type="fixed" address="10.1.1.228" ipVersion="4"/>
Nov 13 17:35:34 user nova-compute[75100]:         </nova:port>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:port uuid="3849db2d-8539-4a60-a828-f0167e4ffd8e">
Nov 13 17:35:34 user nova-compute[75100]:           <nova:ip type="fixed" address="10.1.1.167" ipVersion="4"/>
Nov 13 17:35:34 user nova-compute[75100]:         </nova:port>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:port uuid="94abc659-a0f6-42ce-815c-5aea10c1d2d9">
Nov 13 17:35:34 user nova-compute[75100]:           <nova:ip type="fixed" address="10.1.1.55" ipVersion="4"/>
Nov 13 17:35:34 user nova-compute[75100]:         </nova:port>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:port uuid="1d615688-8ac5-49d1-8497-d846c7cd21b6">
Nov 13 17:35:34 user nova-compute[75100]:           <nova:ip type="fixed" address="10.1.1.82" ipVersion="4"/>
Nov 13 17:35:34 user nova-compute[75100]:         </nova:port>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:port uuid="cbd8d867-99b0-467a-90e5-8f987740ad12">
Nov 13 17:35:34 user nova-compute[75100]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 13 17:35:34 user nova-compute[75100]:         </nova:port>
Nov 13 17:35:34 user nova-compute[75100]:         <nova:port uuid="9063a069-2e42-4058-8355-98ab31c555f1">
Nov 13 17:35:34 user nova-compute[75100]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 13 17:35:34 user nova-compute[75100]:         </nova:port>
Nov 13 17:35:34 user nova-compute[75100]:       </nova:ports>
Nov 13 17:35:34 user nova-compute[75100]:     </nova:instance>
Nov 13 17:35:34 user nova-compute[75100]:   </metadata>
Nov 13 17:35:34 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:35:34 user nova-compute[75100]:     <system>
Nov 13 17:35:34 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:35:34 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:35:34 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:35:34 user nova-compute[75100]:       <entry name="serial">640d6233-140a-4bf0-8155-c309e75cfc1b</entry>
Nov 13 17:35:34 user nova-compute[75100]:       <entry name="uuid">640d6233-140a-4bf0-8155-c309e75cfc1b</entry>
Nov 13 17:35:34 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:35:34 user nova-compute[75100]:     </system>
Nov 13 17:35:34 user nova-compute[75100]:   </sysinfo>
Nov 13 17:35:34 user nova-compute[75100]:   <os>
Nov 13 17:35:34 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:35:34 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:35:34 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:35:34 user nova-compute[75100]:   </os>
Nov 13 17:35:34 user nova-compute[75100]:   <features>
Nov 13 17:35:34 user nova-compute[75100]:     <acpi/>
Nov 13 17:35:34 user nova-compute[75100]:     <apic/>
Nov 13 17:35:34 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:35:34 user nova-compute[75100]:   </features>
Nov 13 17:35:34 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:35:34 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:35:34 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:35:34 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:35:34 user nova-compute[75100]:   </clock>
Nov 13 17:35:34 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:35:34 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:35:34 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:35:34 user nova-compute[75100]:   </cpu>
Nov 13 17:35:34 user nova-compute[75100]:   <devices>
Nov 13 17:35:34 user nova-compute[75100]:     <disk type="file" device="cdrom">
Nov 13 17:35:34 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 17:35:34 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/640d6233-140a-4bf0-8155-c309e75cfc1b/disk.config"/>
Nov 13 17:35:34 user nova-compute[75100]:       <target dev="hda" bus="ide"/>
Nov 13 17:35:34 user nova-compute[75100]:     </disk>
Nov 13 17:35:34 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:35:34 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:35:34 user nova-compute[75100]:       <source dev="/dev/sde"/>
Nov 13 17:35:34 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:35:34 user nova-compute[75100]:       <serial>00cceb1b-0a2d-4836-b40c-e359125647e1</serial>
Nov 13 17:35:34 user nova-compute[75100]:     </disk>
Nov 13 17:35:34 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:35:34 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:35:34 user nova-compute[75100]:       <source dev="/dev/sdi"/>
Nov 13 17:35:34 user nova-compute[75100]:       <target dev="vdb" bus="virtio"/>
Nov 13 17:35:34 user nova-compute[75100]:       <serial>88050523-c59a-49b7-89d3-c38ba0052fd0</serial>
Nov 13 17:35:34 user nova-compute[75100]:     </disk>
Nov 13 17:35:34 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:35:34 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:35:34 user nova-compute[75100]:       <source dev="/dev/sdj"/>
Nov 13 17:35:34 user nova-compute[75100]:       <target dev="vdc" bus="virtio"/>
Nov 13 17:35:34 user nova-compute[75100]:       <serial>5681a9a0-98bd-4070-9682-8dd09420364d</serial>
Nov 13 17:35:34 user nova-compute[75100]:     </disk>
Nov 13 17:35:34 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:35:34 user nova-compute[75100]:       <mac address="fa:16:3e:ff:09:ef"/>
Nov 13 17:35:34 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:35:34 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:35:34 user nova-compute[75100]:       <target dev="tapff6ba9bf-a2"/>
Nov 13 17:35:34 user nova-compute[75100]:     </interface>
Nov 13 17:35:34 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:35:34 user nova-compute[75100]:       <mac address="fa:16:3e:ae:8d:54"/>
Nov 13 17:35:34 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:35:34 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:35:34 user nova-compute[75100]:       <target dev="tap0834a216-c9"/>
Nov 13 17:35:34 user nova-compute[75100]:     </interface>
Nov 13 17:35:34 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:35:34 user nova-compute[75100]:       <mac address="fa:16:3e:e3:49:a3"/>
Nov 13 17:35:34 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:35:34 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:35:34 user nova-compute[75100]:       <target dev="tap3849db2d-85"/>
Nov 13 17:35:34 user nova-compute[75100]:     </interface>
Nov 13 17:35:34 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:35:34 user nova-compute[75100]:       <mac address="fa:16:3e:30:4c:d9"/>
Nov 13 17:35:34 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:35:34 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:35:34 user nova-compute[75100]:       <target dev="tap94abc659-a0"/>
Nov 13 17:35:34 user nova-compute[75100]:     </interface>
Nov 13 17:35:34 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:35:34 user nova-compute[75100]:       <mac address="fa:16:3e:9e:b5:77"/>
Nov 13 17:35:34 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:35:34 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:35:34 user nova-compute[75100]:       <target dev="tap1d615688-8a"/>
Nov 13 17:35:34 user nova-compute[75100]:     </interface>
Nov 13 17:35:34 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:35:34 user nova-compute[75100]:       <mac address="fa:16:3e:27:df:01"/>
Nov 13 17:35:34 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:35:34 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:35:34 user nova-compute[75100]:       <target dev="tapcbd8d867-99"/>
Nov 13 17:35:34 user nova-compute[75100]:     </interface>
Nov 13 17:35:34 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:35:34 user nova-compute[75100]:       <mac address="fa:16:3e:6f:92:c6"/>
Nov 13 17:35:34 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:35:34 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:35:34 user nova-compute[75100]:       <target dev="tap9063a069-2e"/>
Nov 13 17:35:34 user nova-compute[75100]:     </interface>
Nov 13 17:35:34 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:35:34 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/640d6233-140a-4bf0-8155-c309e75cfc1b/console.log" append="off"/>
Nov 13 17:35:34 user nova-compute[75100]:     </serial>
Nov 13 17:35:34 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:35:34 user nova-compute[75100]:     <video>
Nov 13 17:35:34 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:35:34 user nova-compute[75100]:     </video>
Nov 13 17:35:34 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:35:34 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:35:34 user nova-compute[75100]:     </rng>
Nov 13 17:35:34 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:35:34 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:35:34 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:35:34 user nova-compute[75100]:     </memballoon>
Nov 13 17:35:34 user nova-compute[75100]:   </devices>
Nov 13 17:35:34 user nova-compute[75100]: </domain>
Nov 13 17:35:34 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:09:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff6ba9bf-a2e8-410f-aff9-0820512938f0,network=Network(55829031-6f7b-434b-9a1a-5098c061235a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6ba9bf-a2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:09:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff6ba9bf-a2e8-410f-aff9-0820512938f0,network=Network(55829031-6f7b-434b-9a1a-5098c061235a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6ba9bf-a2') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7177a515-0329-5c03-ba95-5f76af9d5b25', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff6ba9bf-a2, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff6ba9bf-a2, col_values=(('qos', UUID('6cb0f78e-9588-4b64-b5c2-be79c04f53fc')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff6ba9bf-a2, col_values=(('external_ids', {'iface-id': 'ff6ba9bf-a2e8-410f-aff9-0820512938f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:09:ef', 'vm-uuid': '640d6233-140a-4bf0-8155-c309e75cfc1b'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: INFO os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:09:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff6ba9bf-a2e8-410f-aff9-0820512938f0,network=Network(55829031-6f7b-434b-9a1a-5098c061235a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6ba9bf-a2')
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:8d:54,bridge_name='br-int',has_traffic_filtering=True,id=0834a216-c9af-4a33-bcdf-3c214e52e109,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0834a216-c9') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:8d:54,bridge_name='br-int',has_traffic_filtering=True,id=0834a216-c9af-4a33-bcdf-3c214e52e109,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0834a216-c9') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac3c486c-bebf-5095-b392-b7b22e121656', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0834a216-c9, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0834a216-c9, col_values=(('qos', UUID('0531d4a2-d361-4108-a312-d65e526054ba')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0834a216-c9, col_values=(('external_ids', {'iface-id': '0834a216-c9af-4a33-bcdf-3c214e52e109', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:8d:54', 'vm-uuid': '640d6233-140a-4bf0-8155-c309e75cfc1b'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: INFO os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:8d:54,bridge_name='br-int',has_traffic_filtering=True,id=0834a216-c9af-4a33-bcdf-3c214e52e109,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0834a216-c9')
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:49:a3,bridge_name='br-int',has_traffic_filtering=True,id=3849db2d-8539-4a60-a828-f0167e4ffd8e,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3849db2d-85') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:49:a3,bridge_name='br-int',has_traffic_filtering=True,id=3849db2d-8539-4a60-a828-f0167e4ffd8e,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3849db2d-85') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d44ecb3-d56b-55aa-9f6e-815fc84338de', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3849db2d-85, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3849db2d-85, col_values=(('qos', UUID('749dcfd0-de84-4d81-951c-9629fdcb4969')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3849db2d-85, col_values=(('external_ids', {'iface-id': '3849db2d-8539-4a60-a828-f0167e4ffd8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:49:a3', 'vm-uuid': '640d6233-140a-4bf0-8155-c309e75cfc1b'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: INFO os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:49:a3,bridge_name='br-int',has_traffic_filtering=True,id=3849db2d-8539-4a60-a828-f0167e4ffd8e,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3849db2d-85')
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:4c:d9,bridge_name='br-int',has_traffic_filtering=True,id=94abc659-a0f6-42ce-815c-5aea10c1d2d9,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc659-a0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:4c:d9,bridge_name='br-int',has_traffic_filtering=True,id=94abc659-a0f6-42ce-815c-5aea10c1d2d9,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc659-a0') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5cd54883-5878-5fa1-bafb-53c20485b5e7', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94abc659-a0, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap94abc659-a0, col_values=(('qos', UUID('482051c2-c59a-4a28-9dfb-8c0a6ae596c4')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap94abc659-a0, col_values=(('external_ids', {'iface-id': '94abc659-a0f6-42ce-815c-5aea10c1d2d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:4c:d9', 'vm-uuid': '640d6233-140a-4bf0-8155-c309e75cfc1b'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: INFO os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:4c:d9,bridge_name='br-int',has_traffic_filtering=True,id=94abc659-a0f6-42ce-815c-5aea10c1d2d9,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc659-a0')
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b5:77,bridge_name='br-int',has_traffic_filtering=True,id=1d615688-8ac5-49d1-8497-d846c7cd21b6,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d615688-8a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b5:77,bridge_name='br-int',has_traffic_filtering=True,id=1d615688-8ac5-49d1-8497-d846c7cd21b6,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d615688-8a') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6658b4b0-7872-5970-8030-42a153f12d5e', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d615688-8a, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d615688-8a, col_values=(('qos', UUID('d8ac5caa-cb84-4b0c-a17f-8350c943ea04')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d615688-8a, col_values=(('external_ids', {'iface-id': '1d615688-8ac5-49d1-8497-d846c7cd21b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:b5:77', 'vm-uuid': '640d6233-140a-4bf0-8155-c309e75cfc1b'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: INFO os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b5:77,bridge_name='br-int',has_traffic_filtering=True,id=1d615688-8ac5-49d1-8497-d846c7cd21b6,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d615688-8a')
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:df:01,bridge_name='br-int',has_traffic_filtering=True,id=cbd8d867-99b0-467a-90e5-8f987740ad12,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd8d867-99') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:df:01,bridge_name='br-int',has_traffic_filtering=True,id=cbd8d867-99b0-467a-90e5-8f987740ad12,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd8d867-99') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e81933a-ee81-51cd-bfd9-91f480cd6816', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbd8d867-99, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbd8d867-99, col_values=(('qos', UUID('ca66bbf7-b7f9-43b8-9409-b0c31a77825c')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbd8d867-99, col_values=(('external_ids', {'iface-id': 'cbd8d867-99b0-467a-90e5-8f987740ad12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:df:01', 'vm-uuid': '640d6233-140a-4bf0-8155-c309e75cfc1b'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: INFO os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:df:01,bridge_name='br-int',has_traffic_filtering=True,id=cbd8d867-99b0-467a-90e5-8f987740ad12,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd8d867-99')
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:92:c6,bridge_name='br-int',has_traffic_filtering=True,id=9063a069-2e42-4058-8355-98ab31c555f1,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9063a069-2e') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:92:c6,bridge_name='br-int',has_traffic_filtering=True,id=9063a069-2e42-4058-8355-98ab31c555f1,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9063a069-2e') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25c62225-b6f4-5e8a-a2ca-c5bc57c169b7', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9063a069-2e, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9063a069-2e, col_values=(('qos', UUID('5f91395f-1259-48f0-b52a-4679384a1123')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9063a069-2e, col_values=(('external_ids', {'iface-id': '9063a069-2e42-4058-8355-98ab31c555f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:92:c6', 'vm-uuid': '640d6233-140a-4bf0-8155-c309e75cfc1b'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:35:35 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7496MB free_disk=24.867874145507812GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:35 user nova-compute[75100]: INFO os_vif [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:92:c6,bridge_name='br-int',has_traffic_filtering=True,id=9063a069-2e42-4058-8355-98ab31c555f1,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9063a069-2e')
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-7fa8215f-2c3f-475c-8661-1fe312c0a174 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] No BDM found with device name hda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] No VIF found with MAC fa:16:3e:ff:09:ef, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] No VIF found with MAC fa:16:3e:9e:b5:77, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:35:35 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Using config drive
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-2d6c7089-629a-45b6-a5eb-9216728da114 req-315b6b43-9832-412e-8ad4-5348df3e281e service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2d6c7089-629a-45b6-a5eb-9216728da114 req-315b6b43-9832-412e-8ad4-5348df3e281e service nova] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2d6c7089-629a-45b6-a5eb-9216728da114 req-315b6b43-9832-412e-8ad4-5348df3e281e service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2d6c7089-629a-45b6-a5eb-9216728da114 req-315b6b43-9832-412e-8ad4-5348df3e281e service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-2d6c7089-629a-45b6-a5eb-9216728da114 req-315b6b43-9832-412e-8ad4-5348df3e281e service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] No waiting events found dispatching network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:35 user nova-compute[75100]: WARNING nova.compute.manager [req-2d6c7089-629a-45b6-a5eb-9216728da114 req-315b6b43-9832-412e-8ad4-5348df3e281e service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received unexpected event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 for instance with vm_state active and task_state None.
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance a5f308a2-3b44-476e-85ab-15e1bf107968 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 73c5d863-7cae-481f-b8ea-dfc217514658 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 82968316-e313-4679-a853-f0d79e988c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 640d6233-140a-4bf0-8155-c309e75cfc1b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:35:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:35:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Creating config drive at /opt/stack/data/nova/instances/640d6233-140a-4bf0-8155-c309e75cfc1b/disk.config
Nov 13 17:35:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/640d6233-140a-4bf0-8155-c309e75cfc1b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplodmgfvm {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing inventories for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/640d6233-140a-4bf0-8155-c309e75cfc1b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplodmgfvm" returned: 0 in 0.055s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating ProviderTree inventory for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating inventory in ProviderTree for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing aggregate associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing trait associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.871s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 17:35:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-8e010ef6-1790-4a6d-9960-2554194bc50a req-12697ec4-b659-486b-af0f-902b94f573b1 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8e010ef6-1790-4a6d-9960-2554194bc50a req-12697ec4-b659-486b-af0f-902b94f573b1 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8e010ef6-1790-4a6d-9960-2554194bc50a req-12697ec4-b659-486b-af0f-902b94f573b1 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8e010ef6-1790-4a6d-9960-2554194bc50a req-12697ec4-b659-486b-af0f-902b94f573b1 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-8e010ef6-1790-4a6d-9960-2554194bc50a req-12697ec4-b659-486b-af0f-902b94f573b1 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:37 user nova-compute[75100]: WARNING nova.compute.manager [req-8e010ef6-1790-4a6d-9960-2554194bc50a req-12697ec4-b659-486b-af0f-902b94f573b1 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-ff6ba9bf-a2e8-410f-aff9-0820512938f0 for instance with vm_state building and task_state spawning.
Nov 13 17:35:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Updating instance_info_cache with network_info: [{"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a3e1007-8e8a-4587-88ef-a5816553e32b req-17704fdc-1c46-426d-84a2-f05ef3d448a8 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-3849db2d-8539-4a60-a828-f0167e4ffd8e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a3e1007-8e8a-4587-88ef-a5816553e32b req-17704fdc-1c46-426d-84a2-f05ef3d448a8 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a3e1007-8e8a-4587-88ef-a5816553e32b req-17704fdc-1c46-426d-84a2-f05ef3d448a8 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6a3e1007-8e8a-4587-88ef-a5816553e32b req-17704fdc-1c46-426d-84a2-f05ef3d448a8 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-6a3e1007-8e8a-4587-88ef-a5816553e32b req-17704fdc-1c46-426d-84a2-f05ef3d448a8 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-3849db2d-8539-4a60-a828-f0167e4ffd8e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:38 user nova-compute[75100]: WARNING nova.compute.manager [req-6a3e1007-8e8a-4587-88ef-a5816553e32b req-17704fdc-1c46-426d-84a2-f05ef3d448a8 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-3849db2d-8539-4a60-a828-f0167e4ffd8e for instance with vm_state building and task_state spawning.
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-db60cfff-5d2d-4577-9aa0-1d69d992e404 req-8ae39a6d-2d4e-4746-b218-848d0bb72ed0 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-db60cfff-5d2d-4577-9aa0-1d69d992e404 req-8ae39a6d-2d4e-4746-b218-848d0bb72ed0 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-db60cfff-5d2d-4577-9aa0-1d69d992e404 req-8ae39a6d-2d4e-4746-b218-848d0bb72ed0 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-db60cfff-5d2d-4577-9aa0-1d69d992e404 req-8ae39a6d-2d4e-4746-b218-848d0bb72ed0 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-db60cfff-5d2d-4577-9aa0-1d69d992e404 req-8ae39a6d-2d4e-4746-b218-848d0bb72ed0 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:38 user nova-compute[75100]: WARNING nova.compute.manager [req-db60cfff-5d2d-4577-9aa0-1d69d992e404 req-8ae39a6d-2d4e-4746-b218-848d0bb72ed0 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-94abc659-a0f6-42ce-815c-5aea10c1d2d9 for instance with vm_state building and task_state spawning.
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:39 user nova-compute[75100]: WARNING nova.compute.manager [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-ff6ba9bf-a2e8-410f-aff9-0820512938f0 for instance with vm_state building and task_state spawning.
Nov 13 17:35:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-0834a216-c9af-4a33-bcdf-3c214e52e109 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-0834a216-c9af-4a33-bcdf-3c214e52e109 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:39 user nova-compute[75100]: WARNING nova.compute.manager [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-0834a216-c9af-4a33-bcdf-3c214e52e109 for instance with vm_state building and task_state spawning.
Nov 13 17:35:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-0834a216-c9af-4a33-bcdf-3c214e52e109 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-0834a216-c9af-4a33-bcdf-3c214e52e109 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:39 user nova-compute[75100]: WARNING nova.compute.manager [req-9345fac5-ee0e-495e-91fa-74c0a11dce08 req-afff87a7-5075-43eb-8fb1-d3699d85941c service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-0834a216-c9af-4a33-bcdf-3c214e52e109 for instance with vm_state building and task_state spawning.
Nov 13 17:35:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-3849db2d-8539-4a60-a828-f0167e4ffd8e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-3849db2d-8539-4a60-a828-f0167e4ffd8e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:40 user nova-compute[75100]: WARNING nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-3849db2d-8539-4a60-a828-f0167e4ffd8e for instance with vm_state building and task_state spawning.
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:40 user nova-compute[75100]: WARNING nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-1d615688-8ac5-49d1-8497-d846c7cd21b6 for instance with vm_state building and task_state spawning.
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:40 user nova-compute[75100]: WARNING nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-1d615688-8ac5-49d1-8497-d846c7cd21b6 for instance with vm_state building and task_state spawning.
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:40 user nova-compute[75100]: WARNING nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-9063a069-2e42-4058-8355-98ab31c555f1 for instance with vm_state building and task_state spawning.
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:40 user nova-compute[75100]: WARNING nova.compute.manager [req-7395671d-101c-493c-b4bf-b3d46931f703 req-0aad128a-5f2e-4608-b232-cf72fb43ce5f service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-9063a069-2e42-4058-8355-98ab31c555f1 for instance with vm_state building and task_state spawning.
Nov 13 17:35:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:40 user nova-compute[75100]: WARNING nova.compute.manager [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-94abc659-a0f6-42ce-815c-5aea10c1d2d9 for instance with vm_state building and task_state spawning.
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:40 user nova-compute[75100]: WARNING nova.compute.manager [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-cbd8d867-99b0-467a-90e5-8f987740ad12 for instance with vm_state building and task_state spawning.
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:35:40 user nova-compute[75100]: WARNING nova.compute.manager [req-ab11c36c-5efc-447d-9b71-8240f327c559 req-ff28979d-9c01-420c-b1db-87e20f364da2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-cbd8d867-99b0-467a-90e5-8f987740ad12 for instance with vm_state building and task_state spawning.
Nov 13 17:35:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:35:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:35:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Instance spawned successfully.
Nov 13 17:35:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:35:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:35:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:35:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:35:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:35:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:35:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:35:41 user nova-compute[75100]: INFO nova.compute.manager [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Took 11.63 seconds to spawn the instance on the hypervisor.
Nov 13 17:35:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:35:41 user nova-compute[75100]: INFO nova.compute.manager [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Took 26.38 seconds to build instance.
Nov 13 17:35:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c09de2ef-86b4-4d61-b02a-c1d7d7f766b5 tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.473s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:43 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a5f308a2-3b44-476e-85ab-15e1bf107968 is timed out.
Nov 13 17:35:43 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Successfully detached device vdb from instance a5f308a2-3b44-476e-85ab-15e1bf107968 from the live domain config.
Nov 13 17:35:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wMKHICND', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:35:43 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:35:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[910bd4cd-82b2-4c58-afe4-b0344fcb8243]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:35:43 user nova-compute[75100]: No targets found.
Nov 13 17:35:43 user nova-compute[75100]: iSNS:
Nov 13 17:35:43 user nova-compute[75100]: No targets found.
Nov 13 17:35:43 user nova-compute[75100]: STATIC:
Nov 13 17:35:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d
Nov 13 17:35:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:35:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0
Nov 13 17:35:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22
Nov 13 17:35:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da
Nov 13 17:35:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:35:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1
Nov 13 17:35:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2
Nov 13 17:35:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:43 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:35:43 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:43 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:43 user nova-compute[75100]: FIRMWARE:
Nov 13 17:35:43 user nova-compute[75100]: No targets found.
Nov 13 17:35:43 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:35:43 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:35:43 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1881c0a5-9853-4ed8-ab4b-b0542cb69b6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f12eb5-b4c0-47fb-af9f-13e732c22971]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:35:43 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:35:43 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:35:43 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38c4fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2'): ({'sdh'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Removing single pathed devices sdh {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cbf09b-f0ef-480f-a648-c0516975759e]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9f8ec5-f2f1-484b-aaa0-3103e3be7b9b]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Flushing IO for device /dev/sdh {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:35:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[38da5600-6838-4938-9bf0-b95c228e2c8a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[17916f60-2e55-41fa-a16a-718a1639f4d6]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] SCSI volumes sdh have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a90c083-e7f5-4309-a117-e12a7e039dba]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68a02f7-051d-498e-acd6-755146727b69]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260]
Nov 13 17:35:44 user nova-compute[75100]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2, portal: 172.16.0.220,3260] successful.
Nov 13 17:35:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9deacb14-d81b-46e6-9701-ec9ce76ebab2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d68626-7f8c-4b28-b7dc-24a7dd1d1ef0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] <== disconnect_volume: return (342ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:35:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'flavor' on Instance uuid a5f308a2-3b44-476e-85ab-15e1bf107968 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7f88c293-1e36-4ad3-b980-7d077a2ac24e tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.760s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f is timed out.
Nov 13 17:35:45 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Successfully detached device vdb from instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f from the live domain config.
Nov 13 17:35:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MHgPJfWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:35:45 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:35:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a30f6a-46cf-4c52-8b26-7fd593ae5a5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:35:45 user nova-compute[75100]: No targets found.
Nov 13 17:35:45 user nova-compute[75100]: iSNS:
Nov 13 17:35:45 user nova-compute[75100]: No targets found.
Nov 13 17:35:45 user nova-compute[75100]: STATIC:
Nov 13 17:35:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d
Nov 13 17:35:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:35:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0
Nov 13 17:35:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22
Nov 13 17:35:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da
Nov 13 17:35:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:35:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1
Nov 13 17:35:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:45 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:35:45 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:35:45 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:35:45 user nova-compute[75100]: FIRMWARE:
Nov 13 17:35:45 user nova-compute[75100]: No targets found.
Nov 13 17:35:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:35:45 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:35:45 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[10895881-3497-4907-82fe-3b443e59f86f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea53be3-a1c3-48e9-8199-b812a5107235]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:35:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:35:46 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:35:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38eec1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da'): ({'sdg'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Removing single pathed devices sdg {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75db595-3e3b-46d9-bbff-699e526c06e7]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[44676dcb-c9b6-44d2-afd4-e702474f7fbf]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Flushing IO for device /dev/sdg {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d76eed-fe4c-41d6-a1ba-2a83f2feb40e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeec11b-c704-4af5-a632-149abbdacb36]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d48983-5498-425e-a807-9a2acee31d89]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f22a49e-c1af-49db-9c00-898ed0dba3ec]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da, portal: 172.16.0.220,3260]
Nov 13 17:35:46 user nova-compute[75100]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da, portal: 172.16.0.220,3260] successful.
Nov 13 17:35:46 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58db2acc-e6cc-45d7-990d-8eb67b54f4da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadf00be-844d-445e-8057-77bad5e6be1b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] <== disconnect_volume: return (363ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:35:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:35:47 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lazy-loading 'flavor' on Instance uuid 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:35:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b9e6bb8d-dd46-4ea2-9b49-d7f5246b74da tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.696s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:35:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:35:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:35:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-360f5360-cce7-4d8d-9635-f16467a2e6eb req-7029fd18-dfa9-4953-bd0b-29e35f4ff7ec service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-changed-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-360f5360-cce7-4d8d-9635-f16467a2e6eb req-7029fd18-dfa9-4953-bd0b-29e35f4ff7ec service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Refreshing instance network info cache due to event network-changed-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-360f5360-cce7-4d8d-9635-f16467a2e6eb req-7029fd18-dfa9-4953-bd0b-29e35f4ff7ec service nova] Acquiring lock "refresh_cache-8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-360f5360-cce7-4d8d-9635-f16467a2e6eb req-7029fd18-dfa9-4953-bd0b-29e35f4ff7ec service nova] Acquired lock "refresh_cache-8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-360f5360-cce7-4d8d-9635-f16467a2e6eb req-7029fd18-dfa9-4953-bd0b-29e35f4ff7ec service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Refreshing network info cache for port f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:01 user nova-compute[75100]: INFO nova.compute.manager [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Terminating instance
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf67fbb1-5385-48a9-92e3-c0545d203de4 req-f5273d2d-ee89-45ba-be88-38126584ea72 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-vif-unplugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf67fbb1-5385-48a9-92e3-c0545d203de4 req-f5273d2d-ee89-45ba-be88-38126584ea72 service nova] Acquiring lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf67fbb1-5385-48a9-92e3-c0545d203de4 req-f5273d2d-ee89-45ba-be88-38126584ea72 service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf67fbb1-5385-48a9-92e3-c0545d203de4 req-f5273d2d-ee89-45ba-be88-38126584ea72 service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf67fbb1-5385-48a9-92e3-c0545d203de4 req-f5273d2d-ee89-45ba-be88-38126584ea72 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] No waiting events found dispatching network-vif-unplugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf67fbb1-5385-48a9-92e3-c0545d203de4 req-f5273d2d-ee89-45ba-be88-38126584ea72 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-vif-unplugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-360f5360-cce7-4d8d-9635-f16467a2e6eb req-7029fd18-dfa9-4953-bd0b-29e35f4ff7ec service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Updated VIF entry in instance network info cache for port f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.network.neutron [req-360f5360-cce7-4d8d-9635-f16467a2e6eb req-7029fd18-dfa9-4953-bd0b-29e35f4ff7ec service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Updating instance_info_cache with network_info: [{"id": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "address": "fa:16:3e:9e:88:54", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a85f7-5b", "ovs_interfaceid": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-360f5360-cce7-4d8d-9635-f16467a2e6eb req-7029fd18-dfa9-4953-bd0b-29e35f4ff7ec service nova] Releasing lock "refresh_cache-8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Instance destroyed successfully.
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.objects.instance [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lazy-loading 'resources' on Instance uuid 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-733714488',display_name='tempest-TestVolumeBootPattern-server-733714488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-733714488',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+NtN2Z5kT0TQJbfKGQsJyKiPak8bepWgNcLUPGujC+AXoGWK840LLNYNacMdPigyvVLHhv89mM2IBFpbgvf3ZqImVEZSa6YyJUnBkkWfhyP+tfJPZtUfdOTGbNpjZ7sA==',key_name='tempest-TestVolumeBootPattern-2052596683',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20bd8fd1a36f49a08be3d97799e847a8',ramdisk_id='',reservation_id='r-w71hp4hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1156978750',owner_user_name='tempest-TestVolumeBootPattern-1156978750-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:31:30Z,user_data=None,user_id='421484d1f180498fa5e078c084d70986',uuid=8fd42f7b-9df1-4b39-9df9-eddcd5c79c23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "address": "fa:16:3e:9e:88:54", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a85f7-5b", "ovs_interfaceid": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converting VIF {"id": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "address": "fa:16:3e:9e:88:54", "network": {"id": "a9eea138-61d2-436f-9038-2071a8afc980", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1882391268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20bd8fd1a36f49a08be3d97799e847a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf51a85f7-5b", "ovs_interfaceid": "f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:88:54,bridge_name='br-int',has_traffic_filtering=True,id=f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf51a85f7-5b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG os_vif [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:88:54,bridge_name='br-int',has_traffic_filtering=True,id=f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf51a85f7-5b') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf51a85f7-5b, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=593b4add-17c7-4fdf-b3e1-ba7760ddce37) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:01 user nova-compute[75100]: INFO os_vif [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:88:54,bridge_name='br-int',has_traffic_filtering=True,id=f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2,network=Network(a9eea138-61d2-436f-9038-2071a8afc980),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf51a85f7-5b')
Nov 13 17:36:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:36:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJYlfmHU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:36:01 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[513fbb85-7c3b-4f09-83b2-942dbc315642]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:36:02 user nova-compute[75100]: No targets found.
Nov 13 17:36:02 user nova-compute[75100]: iSNS:
Nov 13 17:36:02 user nova-compute[75100]: No targets found.
Nov 13 17:36:02 user nova-compute[75100]: STATIC:
Nov 13 17:36:02 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d
Nov 13 17:36:02 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:36:02 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:36:02 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:36:02 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:36:02 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:36:02 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0
Nov 13 17:36:02 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:36:02 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:36:02 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22
Nov 13 17:36:02 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:36:02 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:36:02 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:36:02 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:36:02 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:36:02 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1
Nov 13 17:36:02 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:36:02 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:36:02 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:36:02 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:36:02 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:36:02 user nova-compute[75100]: FIRMWARE:
Nov 13 17:36:02 user nova-compute[75100]: No targets found.
Nov 13 17:36:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:36:02 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:36:02 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcb98ef-0a48-4556-b622-b6a6b27fad3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11e1ea4-2e30-4236-9202-99ef10916eff]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:36:02 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:36:02 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:36:02 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:36:02 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:36:02 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:36:02 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:36:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:36:02 user nova-compute[75100]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 (non-flash)
Nov 13 17:36:02 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:36:02 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:36:02 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:36:02 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:36:02 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:36:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c21a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[71596416-7ff3-4735-8b9c-d6545b3e2ed8]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd23f44e-01f2-42e1-9039-ac2f2364cb0d]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9381ddf-0abc-4b3b-8f12-3c7350457d37]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc0b639-1e50-47e3-8290-e2cc9db191f2]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b1bad0-6df4-4b1c-b267-bb69bea3f137]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6b5569-7185-4b2d-a5b9-744c59b2147b]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260]
Nov 13 17:36:02 user nova-compute[75100]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22, portal: 172.16.0.220,3260] successful.
Nov 13 17:36:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cae63b19-8572-4771-901c-07d61731cd22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1e46db-d13d-49df-912c-883b3e5244ee]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] <== disconnect_volume: return (393ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:36:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Deleting instance files /opt/stack/data/nova/instances/8fd42f7b-9df1-4b39-9df9-eddcd5c79c23_del
Nov 13 17:36:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Deletion of /opt/stack/data/nova/instances/8fd42f7b-9df1-4b39-9df9-eddcd5c79c23_del complete
Nov 13 17:36:02 user nova-compute[75100]: INFO nova.compute.manager [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 13 17:36:02 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:02 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:36:02 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Took 0.43 seconds to deallocate network for instance.
Nov 13 17:36:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-f7b0d661-674d-48d6-9283-2d3a799fdecc req-20c462af-4e7e-4365-89d6-baf3b4f8f1a8 service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-vif-deleted-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Acquiring lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] No waiting events found dispatching network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:36:03 user nova-compute[75100]: WARNING nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received unexpected event network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 for instance with vm_state active and task_state deleting.
Nov 13 17:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Acquiring lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] No waiting events found dispatching network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:36:03 user nova-compute[75100]: WARNING nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received unexpected event network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 for instance with vm_state active and task_state deleting.
Nov 13 17:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Acquiring lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] No waiting events found dispatching network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:36:03 user nova-compute[75100]: WARNING nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received unexpected event network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 for instance with vm_state active and task_state deleting.
Nov 13 17:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-vif-unplugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Acquiring lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] No waiting events found dispatching network-vif-unplugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-vif-unplugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received event network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Acquiring lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] No waiting events found dispatching network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:36:03 user nova-compute[75100]: WARNING nova.compute.manager [req-5f5ddb51-dc69-4772-85a1-b67ad16702ab req-5b70f5da-39b5-479d-a0bd-3deac60c070b service nova] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Received unexpected event network-vif-plugged-f51a85f7-5b9a-4b2a-b0fc-969d6ba3fcd2 for instance with vm_state active and task_state deleting.
Nov 13 17:36:03 user nova-compute[75100]: INFO nova.compute.manager [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] [instance: 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23] Took 0.72 seconds to detach 1 volumes for instance.
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:03 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:36:04 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:36:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:04 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Deleted allocations for instance 8fd42f7b-9df1-4b39-9df9-eddcd5c79c23
Nov 13 17:36:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-51dfb128-d075-46c8-8b8e-3761da613e5d tempest-TestVolumeBootPattern-1156978750 tempest-TestVolumeBootPattern-1156978750-project-member] Lock "8fd42f7b-9df1-4b39-9df9-eddcd5c79c23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.983s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:12 user nova-compute[75100]: INFO nova.compute.manager [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Terminating instance
Nov 13 17:36:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-60863b6f-be1f-474e-8166-c3cf604835c6 req-efa8c03d-9d89-4252-9893-43dbc5d1dc4b service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-unplugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-60863b6f-be1f-474e-8166-c3cf604835c6 req-efa8c03d-9d89-4252-9893-43dbc5d1dc4b service nova] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-60863b6f-be1f-474e-8166-c3cf604835c6 req-efa8c03d-9d89-4252-9893-43dbc5d1dc4b service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-60863b6f-be1f-474e-8166-c3cf604835c6 req-efa8c03d-9d89-4252-9893-43dbc5d1dc4b service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-60863b6f-be1f-474e-8166-c3cf604835c6 req-efa8c03d-9d89-4252-9893-43dbc5d1dc4b service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] No waiting events found dispatching network-vif-unplugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-60863b6f-be1f-474e-8166-c3cf604835c6 req-efa8c03d-9d89-4252-9893-43dbc5d1dc4b service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-unplugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Instance destroyed successfully.
Nov 13 17:36:12 user nova-compute[75100]: DEBUG nova.objects.instance [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lazy-loading 'resources' on Instance uuid 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1748995308',display_name='tempest-ServerRescueNegativeTestJSON-server-1748995308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1748995308',id=2,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6c1d1cfd844465e85239be73eb73cec',ramdisk_id='',reservation_id='r-xo00uc1d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1273984533',owner_user_name='tempest-ServerRescueNegativeTestJSON-1273984533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:26:03Z,user_data=None,user_id='33657093c7ab4112994a1b7e997cfb34',uuid=15b3e2ef-4e0b-4ace-bd74-c34d445b60e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converting VIF {"id": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "address": "fa:16:3e:41:c9:ce", "network": {"id": "60d99f72-0cb5-42de-ac40-729e5e249c1e", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-156315209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6c1d1cfd844465e85239be73eb73cec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66fc9bb6-ce", "ovs_interfaceid": "66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:c9:ce,bridge_name='br-int',has_traffic_filtering=True,id=66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66fc9bb6-ce') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG os_vif [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:c9:ce,bridge_name='br-int',has_traffic_filtering=True,id=66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66fc9bb6-ce') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66fc9bb6-ce, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=181a0497-a627-40ee-9930-1e2935c0fb5b) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:36:12 user nova-compute[75100]: INFO os_vif [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:c9:ce,bridge_name='br-int',has_traffic_filtering=True,id=66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36,network=Network(60d99f72-0cb5-42de-ac40-729e5e249c1e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66fc9bb6-ce')
Nov 13 17:36:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Deleting instance files /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1_del
Nov 13 17:36:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Deletion of /opt/stack/data/nova/instances/15b3e2ef-4e0b-4ace-bd74-c34d445b60e1_del complete
Nov 13 17:36:12 user nova-compute[75100]: INFO nova.compute.manager [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 17:36:12 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:36:12 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:36:13 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:36:13 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Took 0.41 seconds to deallocate network for instance.
Nov 13 17:36:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-c727101f-d479-4eaf-a368-2b2fe8441a13 req-a5aa2628-b05d-4d73-8dc8-b48ee60219f1 service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-deleted-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:13 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:36:13 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:36:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:13 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Deleted allocations for instance 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1
Nov 13 17:36:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-2497e97b-3374-4526-8856-e4078e8f911a tempest-ServerRescueNegativeTestJSON-1273984533 tempest-ServerRescueNegativeTestJSON-1273984533-project-member] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.805s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-f0c52007-5597-47df-a706-6ff95065027c req-64aa27b9-5610-4f59-9690-0ddffea51a2b service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f0c52007-5597-47df-a706-6ff95065027c req-64aa27b9-5610-4f59-9690-0ddffea51a2b service nova] Acquiring lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f0c52007-5597-47df-a706-6ff95065027c req-64aa27b9-5610-4f59-9690-0ddffea51a2b service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f0c52007-5597-47df-a706-6ff95065027c req-64aa27b9-5610-4f59-9690-0ddffea51a2b service nova] Lock "15b3e2ef-4e0b-4ace-bd74-c34d445b60e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-f0c52007-5597-47df-a706-6ff95065027c req-64aa27b9-5610-4f59-9690-0ddffea51a2b service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] No waiting events found dispatching network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:36:14 user nova-compute[75100]: WARNING nova.compute.manager [req-f0c52007-5597-47df-a706-6ff95065027c req-64aa27b9-5610-4f59-9690-0ddffea51a2b service nova] [instance: 15b3e2ef-4e0b-4ace-bd74-c34d445b60e1] Received unexpected event network-vif-plugged-66fc9bb6-ce85-44ed-b2b8-dfb9815d4d36 for instance with vm_state deleted and task_state None.
Nov 13 17:36:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:14 user nova-compute[75100]: INFO nova.compute.manager [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Terminating instance
Nov 13 17:36:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Instance destroyed successfully.
Nov 13 17:36:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'resources' on Instance uuid a5f308a2-3b44-476e-85ab-15e1bf107968 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1606415269',display_name='tempest-TestMinimumBasicScenario-server-1606415269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1606415269',id=31,image_ref='f54422c8-8a7d-4261-92b2-7a48a86048b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbFqeEjBCfPtchoBTJKqBMlcdgUsNVL+XmYOfHVgKSjpw6C8LgkXx5dtm92oBIN3q6lU1BKohKSabIcLqYDIWoqeuTkgxt+/aS5wfehrXw5XF1uomKZNkQcH7ewifI6Rw==',key_name='tempest-TestMinimumBasicScenario-754296732',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dca12c426d0c495b80b77b8ae26be4eb',ramdisk_id='',reservation_id='r-7oh5r93s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f54422c8-8a7d-4261-92b2-7a48a86048b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1769966982',owner_user_name='tempest-TestMinimumBasicScenario-1769966982-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:33:39Z,user_data=None,user_id='2ba71ec67c664e94a71cc9f9107303a5',uuid=a5f308a2-3b44-476e-85ab-15e1bf107968,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converting VIF {"id": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "address": "fa:16:3e:e4:03:2a", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f5b2945-ec", "ovs_interfaceid": "3f5b2945-ec9f-48e7-ada2-3c0cce2f8271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG os_vif [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f5b2945-ec, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=058aaf01-7dda-4527-bb1e-795839d89013) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:36:15 user nova-compute[75100]: INFO os_vif [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:03:2a,bridge_name='br-int',has_traffic_filtering=True,id=3f5b2945-ec9f-48e7-ada2-3c0cce2f8271,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f5b2945-ec')
Nov 13 17:36:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Deleting instance files /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968_del
Nov 13 17:36:15 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Deletion of /opt/stack/data/nova/instances/a5f308a2-3b44-476e-85ab-15e1bf107968_del complete
Nov 13 17:36:15 user nova-compute[75100]: INFO nova.compute.manager [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 13 17:36:15 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:36:15 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:16 user nova-compute[75100]: INFO nova.compute.manager [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Terminating instance
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-a977e3fe-20c2-4c5a-8d4a-d5d8c8697f8e req-761a0c5b-cce8-4f09-bb4a-e080e3f52d20 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-unplugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a977e3fe-20c2-4c5a-8d4a-d5d8c8697f8e req-761a0c5b-cce8-4f09-bb4a-e080e3f52d20 service nova] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a977e3fe-20c2-4c5a-8d4a-d5d8c8697f8e req-761a0c5b-cce8-4f09-bb4a-e080e3f52d20 service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a977e3fe-20c2-4c5a-8d4a-d5d8c8697f8e req-761a0c5b-cce8-4f09-bb4a-e080e3f52d20 service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-a977e3fe-20c2-4c5a-8d4a-d5d8c8697f8e req-761a0c5b-cce8-4f09-bb4a-e080e3f52d20 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] No waiting events found dispatching network-vif-unplugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-a977e3fe-20c2-4c5a-8d4a-d5d8c8697f8e req-761a0c5b-cce8-4f09-bb4a-e080e3f52d20 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-unplugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:36:16 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Took 0.60 seconds to deallocate network for instance.
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-48c567a6-6288-465a-8ba9-2311b458afb8 req-aeed8ebf-eac4-460f-8d12-0e7224a208d0 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-vif-unplugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-48c567a6-6288-465a-8ba9-2311b458afb8 req-aeed8ebf-eac4-460f-8d12-0e7224a208d0 service nova] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-48c567a6-6288-465a-8ba9-2311b458afb8 req-aeed8ebf-eac4-460f-8d12-0e7224a208d0 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-48c567a6-6288-465a-8ba9-2311b458afb8 req-aeed8ebf-eac4-460f-8d12-0e7224a208d0 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-48c567a6-6288-465a-8ba9-2311b458afb8 req-aeed8ebf-eac4-460f-8d12-0e7224a208d0 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] No waiting events found dispatching network-vif-unplugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:36:16 user nova-compute[75100]: WARNING nova.compute.manager [req-48c567a6-6288-465a-8ba9-2311b458afb8 req-aeed8ebf-eac4-460f-8d12-0e7224a208d0 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received unexpected event network-vif-unplugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 for instance with vm_state deleted and task_state None.
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-48c567a6-6288-465a-8ba9-2311b458afb8 req-aeed8ebf-eac4-460f-8d12-0e7224a208d0 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-48c567a6-6288-465a-8ba9-2311b458afb8 req-aeed8ebf-eac4-460f-8d12-0e7224a208d0 service nova] Acquiring lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-48c567a6-6288-465a-8ba9-2311b458afb8 req-aeed8ebf-eac4-460f-8d12-0e7224a208d0 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-48c567a6-6288-465a-8ba9-2311b458afb8 req-aeed8ebf-eac4-460f-8d12-0e7224a208d0 service nova] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-48c567a6-6288-465a-8ba9-2311b458afb8 req-aeed8ebf-eac4-460f-8d12-0e7224a208d0 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] No waiting events found dispatching network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:36:16 user nova-compute[75100]: WARNING nova.compute.manager [req-48c567a6-6288-465a-8ba9-2311b458afb8 req-aeed8ebf-eac4-460f-8d12-0e7224a208d0 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received unexpected event network-vif-plugged-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 for instance with vm_state deleted and task_state None.
Nov 13 17:36:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Instance destroyed successfully.
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.objects.instance [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lazy-loading 'resources' on Instance uuid 2f5b57a9-5bac-4275-a51a-3213d7f9414f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-234989406',display_name='tempest-ServerStableDeviceRescueTest-server-234989406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-234989406',id=27,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHTMZqt3AhpfLX/zImDo+vtV1+wrh9vw8+PaC+kdhYPk4LTG5ahylEV0Kp0Dh27kGA7KM8ig1B7ReH+DTmuQb6ye8DfVW79pPWGcZ5HGnRrkbDfk2JwiCFo2IeHoktdACQ==',key_name='tempest-keypair-831100549',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:33:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb93f95f4f604b9f99a2c9a6fdc96ae8',ramdisk_id='',reservation_id='r-yclingnq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-766369628',owner_user_name='tempest-ServerStableDeviceRescueTest-766369628-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39ea90d2812646af874d709df2efe59e',uuid=2f5b57a9-5bac-4275-a51a-3213d7f9414f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Converting VIF {"id": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "address": "fa:16:3e:da:ef:0d", "network": {"id": "6322d48b-3e6b-499b-a809-69289dee5119", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-642414789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb93f95f4f604b9f99a2c9a6fdc96ae8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4ff1c7-53", "ovs_interfaceid": "0e4ff1c7-53c8-45ff-818e-03d897b1e954", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:ef:0d,bridge_name='br-int',has_traffic_filtering=True,id=0e4ff1c7-53c8-45ff-818e-03d897b1e954,network=Network(6322d48b-3e6b-499b-a809-69289dee5119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4ff1c7-53') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG os_vif [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:ef:0d,bridge_name='br-int',has_traffic_filtering=True,id=0e4ff1c7-53c8-45ff-818e-03d897b1e954,network=Network(6322d48b-3e6b-499b-a809-69289dee5119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4ff1c7-53') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e4ff1c7-53, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7dbac6e0-c329-4956-ab11-aa228ed948cd) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:16 user nova-compute[75100]: INFO os_vif [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:ef:0d,bridge_name='br-int',has_traffic_filtering=True,id=0e4ff1c7-53c8-45ff-818e-03d897b1e954,network=Network(6322d48b-3e6b-499b-a809-69289dee5119),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4ff1c7-53')
Nov 13 17:36:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Deleting instance files /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f_del
Nov 13 17:36:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Deletion of /opt/stack/data/nova/instances/2f5b57a9-5bac-4275-a51a-3213d7f9414f_del complete
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:16 user nova-compute[75100]: INFO nova.compute.manager [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:36:16 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:36:16 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Deleted allocations for instance a5f308a2-3b44-476e-85ab-15e1bf107968
Nov 13 17:36:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1585ce2e-18aa-4654-b433-0d6e8683ca45 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "a5f308a2-3b44-476e-85ab-15e1bf107968" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.030s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:17 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:36:18 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Took 1.15 seconds to deallocate network for instance.
Nov 13 17:36:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:18 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:36:18 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:36:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:18 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Deleted allocations for instance 2f5b57a9-5bac-4275-a51a-3213d7f9414f
Nov 13 17:36:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-46fc27ad-002a-4796-9b1b-abd4fb75b416 req-bd67b55d-f3bf-451a-b80e-f29184c8edd1 service nova] [instance: a5f308a2-3b44-476e-85ab-15e1bf107968] Received event network-vif-deleted-3f5b2945-ec9f-48e7-ada2-3c0cce2f8271 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-46fc27ad-002a-4796-9b1b-abd4fb75b416 req-bd67b55d-f3bf-451a-b80e-f29184c8edd1 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-46fc27ad-002a-4796-9b1b-abd4fb75b416 req-bd67b55d-f3bf-451a-b80e-f29184c8edd1 service nova] Acquiring lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-46fc27ad-002a-4796-9b1b-abd4fb75b416 req-bd67b55d-f3bf-451a-b80e-f29184c8edd1 service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-46fc27ad-002a-4796-9b1b-abd4fb75b416 req-bd67b55d-f3bf-451a-b80e-f29184c8edd1 service nova] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-46fc27ad-002a-4796-9b1b-abd4fb75b416 req-bd67b55d-f3bf-451a-b80e-f29184c8edd1 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] No waiting events found dispatching network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:36:18 user nova-compute[75100]: WARNING nova.compute.manager [req-46fc27ad-002a-4796-9b1b-abd4fb75b416 req-bd67b55d-f3bf-451a-b80e-f29184c8edd1 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received unexpected event network-vif-plugged-0e4ff1c7-53c8-45ff-818e-03d897b1e954 for instance with vm_state deleted and task_state None.
Nov 13 17:36:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-46fc27ad-002a-4796-9b1b-abd4fb75b416 req-bd67b55d-f3bf-451a-b80e-f29184c8edd1 service nova] [instance: 2f5b57a9-5bac-4275-a51a-3213d7f9414f] Received event network-vif-deleted-0e4ff1c7-53c8-45ff-818e-03d897b1e954 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-063a3d1d-1d86-4a4e-b7d3-a49c12f2c35b tempest-ServerStableDeviceRescueTest-766369628 tempest-ServerStableDeviceRescueTest-766369628-project-member] Lock "2f5b57a9-5bac-4275-a51a-3213d7f9414f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.490s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:25 user nova-compute[75100]: INFO nova.compute.manager [None req-ed328e69-633b-41df-9133-39c7e87012a6 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Get console output
Nov 13 17:36:25 user nova-compute[75100]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 13 17:36:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:36:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:36:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:36:29 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:36:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:36:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:36:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:36:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid b0c1af59-f1bd-4c02-8843-e477cd7169d8 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 83d28254-9d5f-4190-85de-76f5a2b69dac {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 73c5d863-7cae-481f-b8ea-dfc217514658 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 82968316-e313-4679-a853-f0d79e988c47 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 640d6233-140a-4bf0-8155-c309e75cfc1b {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "73c5d863-7cae-481f-b8ea-dfc217514658" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "82968316-e313-4679-a853-f0d79e988c47" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "73c5d863-7cae-481f-b8ea-dfc217514658" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "82968316-e313-4679-a853-f0d79e988c47" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:36:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:34 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:36:34 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7878MB free_disk=25.04654312133789GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 73c5d863-7cae-481f-b8ea-dfc217514658 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 82968316-e313-4679-a853-f0d79e988c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 640d6233-140a-4bf0-8155-c309e75cfc1b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:36:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:36:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:36:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:36:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:36:36 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:36:36 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updating instance_info_cache with network_info: [{"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:36:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-b0c1af59-f1bd-4c02-8843-e477cd7169d8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:36:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:36:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:36:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:36:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:36:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-8241407f-645c-4def-a86d-e3e447723dd5 req-44fd6b29-5c7a-4a0c-80cf-556ff8181c85 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Received event network-changed-e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:36:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-8241407f-645c-4def-a86d-e3e447723dd5 req-44fd6b29-5c7a-4a0c-80cf-556ff8181c85 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Refreshing instance network info cache due to event network-changed-e77bf7da-0b83-48f1-838a-67925d77322b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:36:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8241407f-645c-4def-a86d-e3e447723dd5 req-44fd6b29-5c7a-4a0c-80cf-556ff8181c85 service nova] Acquiring lock "refresh_cache-82968316-e313-4679-a853-f0d79e988c47" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:36:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8241407f-645c-4def-a86d-e3e447723dd5 req-44fd6b29-5c7a-4a0c-80cf-556ff8181c85 service nova] Acquired lock "refresh_cache-82968316-e313-4679-a853-f0d79e988c47" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:36:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-8241407f-645c-4def-a86d-e3e447723dd5 req-44fd6b29-5c7a-4a0c-80cf-556ff8181c85 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Refreshing network info cache for port e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:36:49 user nova-compute[75100]: DEBUG nova.network.neutron [req-8241407f-645c-4def-a86d-e3e447723dd5 req-44fd6b29-5c7a-4a0c-80cf-556ff8181c85 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Updated VIF entry in instance network info cache for port e77bf7da-0b83-48f1-838a-67925d77322b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:36:49 user nova-compute[75100]: DEBUG nova.network.neutron [req-8241407f-645c-4def-a86d-e3e447723dd5 req-44fd6b29-5c7a-4a0c-80cf-556ff8181c85 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Updating instance_info_cache with network_info: [{"id": "e77bf7da-0b83-48f1-838a-67925d77322b", "address": "fa:16:3e:e8:37:0e", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77bf7da-0b", "ovs_interfaceid": "e77bf7da-0b83-48f1-838a-67925d77322b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:36:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8241407f-645c-4def-a86d-e3e447723dd5 req-44fd6b29-5c7a-4a0c-80cf-556ff8181c85 service nova] Releasing lock "refresh_cache-82968316-e313-4679-a853-f0d79e988c47" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid 82968316-e313-4679-a853-f0d79e988c47 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:50 user nova-compute[75100]: INFO nova.compute.manager [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Attaching volume e4402ee3-4989-4200-8425-e4cbe6b6530b to /dev/vdb
Nov 13 17:36:50 user nova-compute[75100]: DEBUG os_brick.utils [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbfa352-874f-4725-b565-7619a6899244]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caea9d7-66c8-43fb-8e20-7d724b363cdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[29151994-6732-40c5-a080-e0e870c3dbb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be6800b-925b-4277-a36a-fa5195160c13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:36:50 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:36:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f0dcec-f0e5-41e2-a320-7a4d4964b863]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG os_brick.utils [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:36:50 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Updating existing volume attachment record: 586cda7d-d19a-4bdb-8878-a3a8a241afe7 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:36:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:36:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:36:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:36:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:36:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDnwKmFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:36:54 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:36:54 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:36:54 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf98c89-23ed-4a67-8349-143b51f649e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:36:54 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed5e0f6-f4d0-4fa5-b81a-42922a9d0a62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b] added
Nov 13 17:36:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d411c6f2-5f39-4dfd-b131-c84c6a552e2f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bbc06d-f030-4bdc-b9d6-7c4ece439d48]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDnwKmFC {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bDnwKmFC" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c56b76-b0ad-4563-8d16-c0eb30dbcd11]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bDnwKmFC'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9f42bf-e003-4e0e-a5ed-df60db8a93a0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c02e7a1-1e62-47a5-b4ab-c1344b02201c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:36:54 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:36:54 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:36:54 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:36:54 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:36:54 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:36:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:36:54 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:36:54 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:36:54 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:36:54 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:36:54 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:36:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:36:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff48bde-7eaf-44f9-8bf4-83bcd4f2c6ef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b, portal: 172.16.0.220,3260]
Nov 13 17:36:55 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b, portal: 172.16.0.220,3260] successful.
Nov 13 17:36:55 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a368252b-4928-4ed2-9d61-1a29f517ebe1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e05984-f29c-4374-8002-a29a5df9193b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:36:55 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:36:55 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:36:55 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:36:55 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:36:55 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:36:55 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:36:55 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:36:55 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:36:55 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:36:55 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:36:55 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:36:55 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:36:55 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:36:55 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9014369d-4db2-470a-a2f5-be7c10c194f7]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDnwKmFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:36:56 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26136653865343333', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:36:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136653865343333', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:36:56 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid 82968316-e313-4679-a853-f0d79e988c47 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:36:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:36:56 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:36:56 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 13 17:36:56 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:36:56 user nova-compute[75100]:   <serial>e4402ee3-4989-4200-8425-e4cbe6b6530b</serial>
Nov 13 17:36:56 user nova-compute[75100]: </disk>
Nov 13 17:36:56 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:36:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:36:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:36:56 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No VIF found with MAC fa:16:3e:e8:37:0e, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:36:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d17eb772-d70c-4d99-bc2f-2927abd9667d tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.203s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG nova.objects.instance [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid 82968316-e313-4679-a853-f0d79e988c47 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:36:58 user nova-compute[75100]: INFO nova.compute.manager [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Attaching volume a2cbe300-6e47-472f-8a32-1850647e1b0f to /dev/vdc
Nov 13 17:36:58 user nova-compute[75100]: DEBUG os_brick.utils [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0de30a-8f9e-4fe5-a4aa-b949b49daf0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b205ba1-759d-4538-a09b-b08247b25503]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf0d35c-3a60-4cdb-a95b-61134f108bb3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32d7716-c0b7-4e85-940f-b25e24f1ea7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:36:58 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:36:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c682ee-ec7c-4afa-aef3-336de18f6b2d]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG os_brick.utils [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:36:58 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Updating existing volume attachment record: 56625d02-7396-4c32-9a4d-5d64aec8b541 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:37:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLVGUbDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:37:03 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:37:03 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:37:03 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5406cb02-2c1c-4719-9f01-fa80399f028c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:37:03 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73bfbf8-8f38-4fb2-b525-c48f9b66af7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f] added
Nov 13 17:37:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acd6fff-975f-4fef-ad5e-a29fbee2cf71]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34a3da2-58ee-42ae-8dd3-9b8c9a96e3b2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zLVGUbDp {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zLVGUbDp" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae0ee52-682e-4c09-af46-418349598337]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zLVGUbDp'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2c478c-ce7e-429f-b582-8d561897413a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2f2682-112d-43eb-8ea8-2ffb6411a95f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[323740a0-3c34-434e-8951-a68fcc1e50e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f, portal: 172.16.0.220,3260]
Nov 13 17:37:03 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f, portal: 172.16.0.220,3260] successful.
Nov 13 17:37:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b8aa09-9d91-49f4-8fb4-5d6280dc673f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f87fae-f3dd-41a0-a396-59e70e9114c4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:03 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] HCTL ('38', '-', '-', 0) found on session 46 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4df8cbb-f41b-440d-af48-ae3869d5386e]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Searching for a device in session 46 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:37:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLVGUbDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:37:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:37:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26437656536643136', 'path': '/dev/sdg'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:37:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437656536643136', 'path': '/dev/sdg'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:37:04 user nova-compute[75100]: DEBUG nova.objects.instance [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid 82968316-e313-4679-a853-f0d79e988c47 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:37:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:37:04 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:37:04 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:37:04 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 13 17:37:04 user nova-compute[75100]:   <serial>a2cbe300-6e47-472f-8a32-1850647e1b0f</serial>
Nov 13 17:37:04 user nova-compute[75100]: </disk>
Nov 13 17:37:04 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:37:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:37:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:37:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:37:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] No VIF found with MAC fa:16:3e:e8:37:0e, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:37:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-29b46cfa-9772-4236-bf7c-17215b1cbbcd tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.217s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:05 user nova-compute[75100]: INFO nova.compute.manager [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Detaching volume e4402ee3-4989-4200-8425-e4cbe6b6530b
Nov 13 17:37:05 user nova-compute[75100]: INFO nova.virt.block_device [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Attempting to driver detach volume e4402ee3-4989-4200-8425-e4cbe6b6530b from mountpoint /dev/vdb
Nov 13 17:37:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Attempting to detach device vdb from instance 82968316-e313-4679-a853-f0d79e988c47 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:37:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:37:05 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:37:05 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 13 17:37:05 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:37:05 user nova-compute[75100]:   <serial>e4402ee3-4989-4200-8425-e4cbe6b6530b</serial>
Nov 13 17:37:05 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:37:05 user nova-compute[75100]: </disk>
Nov 13 17:37:05 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:37:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully detached device vdb from instance 82968316-e313-4679-a853-f0d79e988c47 from the persistent domain config.
Nov 13 17:37:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82968316-e313-4679-a853-f0d79e988c47 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:37:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:37:05 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:37:05 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 13 17:37:05 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:37:05 user nova-compute[75100]:   <serial>e4402ee3-4989-4200-8425-e4cbe6b6530b</serial>
Nov 13 17:37:05 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:37:05 user nova-compute[75100]: </disk>
Nov 13 17:37:05 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:37:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82968316-e313-4679-a853-f0d79e988c47 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:37:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-d1316068-409a-4f9e-b242-dd283ded5f6d req-8cc800a7-6841-4b79-b918-3f74739bd5e4 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-changed-ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-d1316068-409a-4f9e-b242-dd283ded5f6d req-8cc800a7-6841-4b79-b918-3f74739bd5e4 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing instance network info cache due to event network-changed-ff6ba9bf-a2e8-410f-aff9-0820512938f0. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:37:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d1316068-409a-4f9e-b242-dd283ded5f6d req-8cc800a7-6841-4b79-b918-3f74739bd5e4 service nova] Acquiring lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:37:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d1316068-409a-4f9e-b242-dd283ded5f6d req-8cc800a7-6841-4b79-b918-3f74739bd5e4 service nova] Acquired lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:37:06 user nova-compute[75100]: DEBUG nova.network.neutron [req-d1316068-409a-4f9e-b242-dd283ded5f6d req-8cc800a7-6841-4b79-b918-3f74739bd5e4 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Refreshing network info cache for port ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:37:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:07 user nova-compute[75100]: DEBUG nova.network.neutron [req-d1316068-409a-4f9e-b242-dd283ded5f6d req-8cc800a7-6841-4b79-b918-3f74739bd5e4 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updated VIF entry in instance network info cache for port ff6ba9bf-a2e8-410f-aff9-0820512938f0. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:37:07 user nova-compute[75100]: DEBUG nova.network.neutron [req-d1316068-409a-4f9e-b242-dd283ded5f6d req-8cc800a7-6841-4b79-b918-3f74739bd5e4 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [{"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d1316068-409a-4f9e-b242-dd283ded5f6d req-8cc800a7-6841-4b79-b918-3f74739bd5e4 service nova] Releasing lock "refresh_cache-640d6233-140a-4bf0-8155-c309e75cfc1b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:37:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:37:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:09 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:37:09 user nova-compute[75100]: INFO nova.compute.claims [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Claim successful on node user
Nov 13 17:37:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:09 user nova-compute[75100]: INFO nova.compute.manager [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Terminating instance
Nov 13 17:37:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:37:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.network.neutron [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:37:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-018affdc-5058-4011-9fcb-1407722994cb req-e43852a9-29df-435f-9595-9404666e3117 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-3849db2d-8539-4a60-a828-f0167e4ffd8e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-018affdc-5058-4011-9fcb-1407722994cb req-e43852a9-29df-435f-9595-9404666e3117 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-018affdc-5058-4011-9fcb-1407722994cb req-e43852a9-29df-435f-9595-9404666e3117 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-018affdc-5058-4011-9fcb-1407722994cb req-e43852a9-29df-435f-9595-9404666e3117 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-018affdc-5058-4011-9fcb-1407722994cb req-e43852a9-29df-435f-9595-9404666e3117 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-unplugged-3849db2d-8539-4a60-a828-f0167e4ffd8e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-018affdc-5058-4011-9fcb-1407722994cb req-e43852a9-29df-435f-9595-9404666e3117 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-3849db2d-8539-4a60-a828-f0167e4ffd8e for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:37:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Creating image(s)
Nov 13 17:37:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "/opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "/opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "917a56892bf47e22539f4dd61e38f45ce2c86739" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "917a56892bf47e22539f4dd61e38f45ce2c86739" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-4fcc4d2e-6439-466e-928e-2fc71a676730 req-b2065160-6682-4076-a306-b063097daff3 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4fcc4d2e-6439-466e-928e-2fc71a676730 req-b2065160-6682-4076-a306-b063097daff3 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4fcc4d2e-6439-466e-928e-2fc71a676730 req-b2065160-6682-4076-a306-b063097daff3 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4fcc4d2e-6439-466e-928e-2fc71a676730 req-b2065160-6682-4076-a306-b063097daff3 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-4fcc4d2e-6439-466e-928e-2fc71a676730 req-b2065160-6682-4076-a306-b063097daff3 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-unplugged-94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-4fcc4d2e-6439-466e-928e-2fc71a676730 req-b2065160-6682-4076-a306-b063097daff3 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-94abc659-a0f6-42ce-815c-5aea10c1d2d9 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:10 user nova-compute[75100]: DEBUG nova.policy [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ba71ec67c664e94a71cc9f9107303a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dca12c426d0c495b80b77b8ae26be4eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-df6643c1-f3f4-4d4a-82fc-c5d51606d569 req-b255955a-5ecc-4229-ac01-106a33eb14d4 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df6643c1-f3f4-4d4a-82fc-c5d51606d569 req-b255955a-5ecc-4229-ac01-106a33eb14d4 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df6643c1-f3f4-4d4a-82fc-c5d51606d569 req-b255955a-5ecc-4229-ac01-106a33eb14d4 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-df6643c1-f3f4-4d4a-82fc-c5d51606d569 req-b255955a-5ecc-4229-ac01-106a33eb14d4 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-df6643c1-f3f4-4d4a-82fc-c5d51606d569 req-b255955a-5ecc-4229-ac01-106a33eb14d4 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-unplugged-ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-df6643c1-f3f4-4d4a-82fc-c5d51606d569 req-b255955a-5ecc-4229-ac01-106a33eb14d4 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-ff6ba9bf-a2e8-410f-aff9-0820512938f0 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739.part --force-share --output=json" returned: 0 in 0.230s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG nova.virt.images [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] a5e8ded8-4c58-4f04-aeea-b6e9452780d1 was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739.part /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739.part /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739.converted" returned: 0 in 0.435s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:12 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Instance destroyed successfully.
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lazy-loading 'resources' on Instance uuid 640d6233-140a-4bf0-8155-c309e75cfc1b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:09:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff6ba9bf-a2e8-410f-aff9-0820512938f0,network=Network(55829031-6f7b-434b-9a1a-5098c061235a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6ba9bf-a2') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:09:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff6ba9bf-a2e8-410f-aff9-0820512938f0,network=Network(55829031-6f7b-434b-9a1a-5098c061235a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6ba9bf-a2') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff6ba9bf-a2, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6cb0f78e-9588-4b64-b5c2-be79c04f53fc) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "917a56892bf47e22539f4dd61e38f45ce2c86739" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.564s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: INFO os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:09:ef,bridge_name='br-int',has_traffic_filtering=True,id=ff6ba9bf-a2e8-410f-aff9-0820512938f0,network=Network(55829031-6f7b-434b-9a1a-5098c061235a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff6ba9bf-a2')
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:8d:54,bridge_name='br-int',has_traffic_filtering=True,id=0834a216-c9af-4a33-bcdf-3c214e52e109,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0834a216-c9') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:8d:54,bridge_name='br-int',has_traffic_filtering=True,id=0834a216-c9af-4a33-bcdf-3c214e52e109,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0834a216-c9') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0834a216-c9, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0531d4a2-d361-4108-a312-d65e526054ba) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: INFO os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:8d:54,bridge_name='br-int',has_traffic_filtering=True,id=0834a216-c9af-4a33-bcdf-3c214e52e109,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0834a216-c9')
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:49:a3,bridge_name='br-int',has_traffic_filtering=True,id=3849db2d-8539-4a60-a828-f0167e4ffd8e,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3849db2d-85') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:49:a3,bridge_name='br-int',has_traffic_filtering=True,id=3849db2d-8539-4a60-a828-f0167e4ffd8e,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3849db2d-85') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3849db2d-85, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739 --force-share --output=json" returned: 0 in 0.234s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "917a56892bf47e22539f4dd61e38f45ce2c86739" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "917a56892bf47e22539f4dd61e38f45ce2c86739" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=749dcfd0-de84-4d81-951c-9629fdcb4969) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: INFO os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:49:a3,bridge_name='br-int',has_traffic_filtering=True,id=3849db2d-8539-4a60-a828-f0167e4ffd8e,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3849db2d-85')
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "address": "fa:16:3e:30:4c:d9", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.55", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94abc659-a0", "ovs_interfaceid": "94abc659-a0f6-42ce-815c-5aea10c1d2d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:4c:d9,bridge_name='br-int',has_traffic_filtering=True,id=94abc659-a0f6-42ce-815c-5aea10c1d2d9,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc659-a0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:4c:d9,bridge_name='br-int',has_traffic_filtering=True,id=94abc659-a0f6-42ce-815c-5aea10c1d2d9,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc659-a0') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94abc659-a0, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-3849db2d-8539-4a60-a828-f0167e4ffd8e {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-3849db2d-8539-4a60-a828-f0167e4ffd8e {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:12 user nova-compute[75100]: WARNING nova.compute.manager [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-3849db2d-8539-4a60-a828-f0167e4ffd8e for instance with vm_state active and task_state deleting.
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-unplugged-1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-1d615688-8ac5-49d1-8497-d846c7cd21b6 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:12 user nova-compute[75100]: WARNING nova.compute.manager [req-2969a003-7ff3-4a84-9b88-b87cca8909d4 req-1715438b-6c4c-4272-b00f-400fa6e13ae7 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-1d615688-8ac5-49d1-8497-d846c7cd21b6 for instance with vm_state active and task_state deleting.
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739 --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739,backing_fmt=raw /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739,backing_fmt=raw /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk 1073741824" returned: 0 in 0.055s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "917a56892bf47e22539f4dd61e38f45ce2c86739" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:12 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:13 user nova-compute[75100]: WARNING nova.compute.manager [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-94abc659-a0f6-42ce-815c-5aea10c1d2d9 for instance with vm_state active and task_state deleting.
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-unplugged-cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-cbd8d867-99b0-467a-90e5-8f987740ad12 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:13 user nova-compute[75100]: WARNING nova.compute.manager [req-2a0f13f1-406c-4bf8-91b8-2abe6d560714 req-5c35da3c-4548-408f-bfbe-4c1709b3aab2 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-cbd8d867-99b0-467a-90e5-8f987740ad12 for instance with vm_state active and task_state deleting.
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:13 user nova-compute[75100]: WARNING nova.compute.manager [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-ff6ba9bf-a2e8-410f-aff9-0820512938f0 for instance with vm_state active and task_state deleting.
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-0834a216-c9af-4a33-bcdf-3c214e52e109 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-unplugged-0834a216-c9af-4a33-bcdf-3c214e52e109 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-0834a216-c9af-4a33-bcdf-3c214e52e109 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-0834a216-c9af-4a33-bcdf-3c214e52e109 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-0834a216-c9af-4a33-bcdf-3c214e52e109 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:13 user nova-compute[75100]: WARNING nova.compute.manager [req-6428e1e0-771b-4abb-8bf7-8f33bc4f6996 req-2be1c433-99cb-4913-ad4c-7e0039666a82 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-0834a216-c9af-4a33-bcdf-3c214e52e109 for instance with vm_state active and task_state deleting.
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739 --force-share --output=json" returned: 0 in 0.494s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=482051c2-c59a-4a28-9dfb-8c0a6ae596c4) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:13 user nova-compute[75100]: INFO os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:4c:d9,bridge_name='br-int',has_traffic_filtering=True,id=94abc659-a0f6-42ce-815c-5aea10c1d2d9,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94abc659-a0')
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b5:77,bridge_name='br-int',has_traffic_filtering=True,id=1d615688-8ac5-49d1-8497-d846c7cd21b6,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d615688-8a') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b5:77,bridge_name='br-int',has_traffic_filtering=True,id=1d615688-8ac5-49d1-8497-d846c7cd21b6,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d615688-8a') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d615688-8a, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8ac5caa-cb84-4b0c-a17f-8350c943ea04) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: INFO os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:b5:77,bridge_name='br-int',has_traffic_filtering=True,id=1d615688-8ac5-49d1-8497-d846c7cd21b6,network=Network(d24710ae-beb0-417c-974c-c9bfb85b7732),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d615688-8a')
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:df:01,bridge_name='br-int',has_traffic_filtering=True,id=cbd8d867-99b0-467a-90e5-8f987740ad12,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd8d867-99') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:df:01,bridge_name='br-int',has_traffic_filtering=True,id=cbd8d867-99b0-467a-90e5-8f987740ad12,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd8d867-99') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbd8d867-99, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca66bbf7-b7f9-43b8-9409-b0c31a77825c) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: INFO os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:df:01,bridge_name='br-int',has_traffic_filtering=True,id=cbd8d867-99b0-467a-90e5-8f987740ad12,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbd8d867-99')
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T17:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-663101775',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-663101775',id=35,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF218G4S5TU1gZsdK8KN9TmBNq1r3NXsT5zlsWYt6l3FTol1KxzlrL+OhssODcAwCaqlFZ8ln4oyfsEYlNW20+K4LCZIW7TaFWaLe+Twbp63nbMffSa1Mn9uZVb99KqZKQ==',key_name='tempest-keypair-168092934',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1590c0bc0e2d44f89729b0ae32904fcd',ramdisk_id='',reservation_id='r-dgs64w0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1067443993',owner_user_name='tempest-TaggedBootDevicesTest_v242-1067443993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4316b59045e5428a855d54bed24c5170',uuid=640d6233-140a-4bf0-8155-c309e75cfc1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converting VIF {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:92:c6,bridge_name='br-int',has_traffic_filtering=True,id=9063a069-2e42-4058-8355-98ab31c555f1,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9063a069-2e') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:92:c6,bridge_name='br-int',has_traffic_filtering=True,id=9063a069-2e42-4058-8355-98ab31c555f1,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9063a069-2e') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9063a069-2e, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f91395f-1259-48f0-b52a-4679384a1123) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Cannot resize image /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Ensure instance console log exists: /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:13 user nova-compute[75100]: INFO os_vif [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:92:c6,bridge_name='br-int',has_traffic_filtering=True,id=9063a069-2e42-4058-8355-98ab31c555f1,network=Network(19dd5c66-bb3a-4a57-bea9-7dcc1df78b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9063a069-2e')
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.network.neutron [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Successfully created port: bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiycsATw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:37:13 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6c5c8f-a8c8-4c33-afd0-217a9f591555]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:37:13 user nova-compute[75100]: No targets found.
Nov 13 17:37:13 user nova-compute[75100]: iSNS:
Nov 13 17:37:13 user nova-compute[75100]: No targets found.
Nov 13 17:37:13 user nova-compute[75100]: STATIC:
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: FIRMWARE:
Nov 13 17:37:13 user nova-compute[75100]: No targets found.
Nov 13 17:37:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:37:13 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:37:13 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b086e7a6-3867-452d-81a4-fc5f8170405d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deb58e1-0eeb-4a88-82ef-2c12ef5e9f7f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3 (non-flash)
Nov 13 17:37:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:13 user nova-compute[75100]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3 (non-flash)
Nov 13 17:37:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38c4d480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb82322-6b35-4d1f-941b-be96bc533710]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ad6f68-f5d6-4ca1-8d1c-302ae44ab3a1]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea03146-fda4-4584-ba3d-87225c56c4bb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[005565f8-5124-4ae1-ba5d-ca864b5f7384]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ef0c39-f5b5-46ed-9ebe-18ef95fb973e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.126s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[059e385f-03ad-450e-98cd-57d507f7da08]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1, portal: 172.16.0.220,3260]
Nov 13 17:37:13 user nova-compute[75100]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1, portal: 172.16.0.220,3260] successful.
Nov 13 17:37:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00cceb1b-0a2d-4836-b40c-e359125647e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce5323b-e956-4c0c-abdf-303c35af7053]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] <== disconnect_volume: return (429ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKhxDOsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:37:13 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d902ecd-aac6-4f7e-989f-00522e4a9161]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:37:13 user nova-compute[75100]: No targets found.
Nov 13 17:37:13 user nova-compute[75100]: iSNS:
Nov 13 17:37:13 user nova-compute[75100]: No targets found.
Nov 13 17:37:13 user nova-compute[75100]: STATIC:
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:37:13 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:13 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:13 user nova-compute[75100]: FIRMWARE:
Nov 13 17:37:13 user nova-compute[75100]: No targets found.
Nov 13 17:37:13 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:37:13 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:37:13 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:13 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cea247-1a51-423e-ba0a-3d7dae97ab99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f092b4f-fb70-48a2-92af-72bd152a8a54]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38c4cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0'): ({'sdi'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Removing single pathed devices sdi {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[570ef621-9672-47c0-acf3-76b65fb7cd76]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f353f107-e3d3-4d23-8089-0264bbe762b3]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Flushing IO for device /dev/sdi {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.060s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6fb62a-6e99-4b9e-a371-fcf5b7c470e7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.073s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cee8d7-8345-4b46-81ef-983c652a15e6]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] SCSI volumes sdi have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[993b031a-7f17-4a24-a339-e50df98168c5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a316317a-2e95-4d02-9019-70e4d29b72d9]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0, portal: 172.16.0.220,3260]
Nov 13 17:37:14 user nova-compute[75100]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0, portal: 172.16.0.220,3260] successful.
Nov 13 17:37:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88050523-c59a-49b7-89d3-c38ba0052fd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dba3c6-ba84-4c50-9cd7-f96c7f1ecb54]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.478s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] <== disconnect_volume: return (481ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VScYOXvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:37:14 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f868fd-0e28-4163-8e4e-e3d37817448e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:37:14 user nova-compute[75100]: No targets found.
Nov 13 17:37:14 user nova-compute[75100]: iSNS:
Nov 13 17:37:14 user nova-compute[75100]: No targets found.
Nov 13 17:37:14 user nova-compute[75100]: STATIC:
Nov 13 17:37:14 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d
Nov 13 17:37:14 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:14 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:14 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:37:14 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:14 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:14 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f
Nov 13 17:37:14 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:14 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:14 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3
Nov 13 17:37:14 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:14 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:14 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:37:14 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:14 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:14 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b
Nov 13 17:37:14 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:14 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:14 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:37:14 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:14 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:14 user nova-compute[75100]: FIRMWARE:
Nov 13 17:37:14 user nova-compute[75100]: No targets found.
Nov 13 17:37:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:37:14 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:37:14 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99d0995-0f70-44e5-98ec-3809300870ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a165edc7-a30b-4380-9848-bb678cbb047b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:14 user nova-compute[75100]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fd839d9-a384-49c8-ad69-85568cac89e3 (non-flash)
Nov 13 17:37:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38c4fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d'): ({'sdj'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Removing single pathed devices sdj {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b49d07-c5ed-4bc2-8b88-f6b1f147dc5e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0aea55-3aa6-4993-9666-5e452ea567de]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Flushing IO for device /dev/sdj {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[147b1156-a99b-4762-9647-3ae36bbb266f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4422bf0d-3ada-471b-9768-327562e56df2]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] SCSI volumes sdj have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b303896-9fe8-45e4-9211-dc199410f922]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Successfully updated port: bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-8eecdad0-b6f5-46c0-a2b2-dcf7424a4557 req-8f65d7bf-3525-4fd9-8fe4-9f6995587e40 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8eecdad0-b6f5-46c0-a2b2-dcf7424a4557 req-8f65d7bf-3525-4fd9-8fe4-9f6995587e40 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8eecdad0-b6f5-46c0-a2b2-dcf7424a4557 req-8f65d7bf-3525-4fd9-8fe4-9f6995587e40 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8eecdad0-b6f5-46c0-a2b2-dcf7424a4557 req-8f65d7bf-3525-4fd9-8fe4-9f6995587e40 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-8eecdad0-b6f5-46c0-a2b2-dcf7424a4557 req-8f65d7bf-3525-4fd9-8fe4-9f6995587e40 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-unplugged-9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-8eecdad0-b6f5-46c0-a2b2-dcf7424a4557 req-8f65d7bf-3525-4fd9-8fe4-9f6995587e40 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-unplugged-9063a069-2e42-4058-8355-98ab31c555f1 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-8eecdad0-b6f5-46c0-a2b2-dcf7424a4557 req-8f65d7bf-3525-4fd9-8fe4-9f6995587e40 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-plugged-9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8eecdad0-b6f5-46c0-a2b2-dcf7424a4557 req-8f65d7bf-3525-4fd9-8fe4-9f6995587e40 service nova] Acquiring lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8eecdad0-b6f5-46c0-a2b2-dcf7424a4557 req-8f65d7bf-3525-4fd9-8fe4-9f6995587e40 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8eecdad0-b6f5-46c0-a2b2-dcf7424a4557 req-8f65d7bf-3525-4fd9-8fe4-9f6995587e40 service nova] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-8eecdad0-b6f5-46c0-a2b2-dcf7424a4557 req-8f65d7bf-3525-4fd9-8fe4-9f6995587e40 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] No waiting events found dispatching network-vif-plugged-9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:14 user nova-compute[75100]: WARNING nova.compute.manager [req-8eecdad0-b6f5-46c0-a2b2-dcf7424a4557 req-8f65d7bf-3525-4fd9-8fe4-9f6995587e40 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received unexpected event network-vif-plugged-9063a069-2e42-4058-8355-98ab31c555f1 for instance with vm_state active and task_state deleting.
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquired lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bba913-e849-45c0-a22e-15858dacf7bf]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d, portal: 172.16.0.220,3260]
Nov 13 17:37:14 user nova-compute[75100]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d, portal: 172.16.0.220,3260] successful.
Nov 13 17:37:14 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5681a9a0-98bd-4070-9682-8dd09420364d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b586ab-a874-46e8-87f3-33f8fed3c1d6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] <== disconnect_volume: return (415ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:37:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Deleting instance files /opt/stack/data/nova/instances/640d6233-140a-4bf0-8155-c309e75cfc1b_del
Nov 13 17:37:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Deletion of /opt/stack/data/nova/instances/640d6233-140a-4bf0-8155-c309e75cfc1b_del complete
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:37:14 user nova-compute[75100]: INFO nova.compute.manager [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Took 5.02 seconds to destroy the instance on the hypervisor.
Nov 13 17:37:14 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:37:14 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updating instance_info_cache with network_info: [{"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Releasing lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Instance network_info: |[{"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Start _get_guest_xml network_info=[{"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:37:06Z,direct_url=<?>,disk_format='qcow2',id=a5e8ded8-4c58-4f04-aeea-b6e9452780d1,min_disk=0,min_ram=0,name='tempest-scenario-img--137231036',owner='dca12c426d0c495b80b77b8ae26be4eb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:37:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'a5e8ded8-4c58-4f04-aeea-b6e9452780d1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:37:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:37:15 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:37:06Z,direct_url=<?>,disk_format='qcow2',id=a5e8ded8-4c58-4f04-aeea-b6e9452780d1,min_disk=0,min_ram=0,name='tempest-scenario-img--137231036',owner='dca12c426d0c495b80b77b8ae26be4eb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:37:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:37:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-271909253',display_name='tempest-TestMinimumBasicScenario-server-271909253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-271909253',id=36,image_ref='a5e8ded8-4c58-4f04-aeea-b6e9452780d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/jb2gAq4MPFGLmeCSDS7e2R6FXMvVNiV2zxrLc46Ggp78cgynx93QfCXmvNb38jvNvbInYQwlwoBXg3gXv0yoVr1YOUrhIS0tHT/r2eWJO3p9j9SA4XHdo6+7SPcSXaQ==',key_name='tempest-TestMinimumBasicScenario-863798775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca12c426d0c495b80b77b8ae26be4eb',ramdisk_id='',reservation_id='r-4scowcic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a5e8ded8-4c58-4f04-aeea-b6e9452780d1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1769966982',owner_user_name='tempest-TestMinimumBasicScenario-1769966982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:37:11Z,user_data=None,user_id='2ba71ec67c664e94a71cc9f9107303a5',uuid=6c6dba6f-fa48-4d7f-a529-d0215f251fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converting VIF {"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:df:da,bridge_name='br-int',has_traffic_filtering=True,id=bde2a813-7715-4fc1-a99e-f3cc8484988b,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde2a813-77') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:37:15 user nova-compute[75100]:   <uuid>6c6dba6f-fa48-4d7f-a529-d0215f251fc2</uuid>
Nov 13 17:37:15 user nova-compute[75100]:   <name>instance-00000024</name>
Nov 13 17:37:15 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:37:15 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:37:15 user nova-compute[75100]:   <metadata>
Nov 13 17:37:15 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:37:15 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:37:15 user nova-compute[75100]:       <nova:name>tempest-TestMinimumBasicScenario-server-271909253</nova:name>
Nov 13 17:37:15 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:37:15</nova:creationTime>
Nov 13 17:37:15 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:37:15 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:37:15 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:37:15 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:37:15 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:37:15 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:37:15 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:37:15 user nova-compute[75100]:       <nova:owner>
Nov 13 17:37:15 user nova-compute[75100]:         <nova:user uuid="2ba71ec67c664e94a71cc9f9107303a5">tempest-TestMinimumBasicScenario-1769966982-project-member</nova:user>
Nov 13 17:37:15 user nova-compute[75100]:         <nova:project uuid="dca12c426d0c495b80b77b8ae26be4eb">tempest-TestMinimumBasicScenario-1769966982</nova:project>
Nov 13 17:37:15 user nova-compute[75100]:       </nova:owner>
Nov 13 17:37:15 user nova-compute[75100]:       <nova:root type="image" uuid="a5e8ded8-4c58-4f04-aeea-b6e9452780d1"/>
Nov 13 17:37:15 user nova-compute[75100]:       <nova:ports>
Nov 13 17:37:15 user nova-compute[75100]:         <nova:port uuid="bde2a813-7715-4fc1-a99e-f3cc8484988b">
Nov 13 17:37:15 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 17:37:15 user nova-compute[75100]:         </nova:port>
Nov 13 17:37:15 user nova-compute[75100]:       </nova:ports>
Nov 13 17:37:15 user nova-compute[75100]:     </nova:instance>
Nov 13 17:37:15 user nova-compute[75100]:   </metadata>
Nov 13 17:37:15 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:37:15 user nova-compute[75100]:     <system>
Nov 13 17:37:15 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:37:15 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:37:15 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:37:15 user nova-compute[75100]:       <entry name="serial">6c6dba6f-fa48-4d7f-a529-d0215f251fc2</entry>
Nov 13 17:37:15 user nova-compute[75100]:       <entry name="uuid">6c6dba6f-fa48-4d7f-a529-d0215f251fc2</entry>
Nov 13 17:37:15 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:37:15 user nova-compute[75100]:     </system>
Nov 13 17:37:15 user nova-compute[75100]:   </sysinfo>
Nov 13 17:37:15 user nova-compute[75100]:   <os>
Nov 13 17:37:15 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:37:15 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:37:15 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:37:15 user nova-compute[75100]:   </os>
Nov 13 17:37:15 user nova-compute[75100]:   <features>
Nov 13 17:37:15 user nova-compute[75100]:     <acpi/>
Nov 13 17:37:15 user nova-compute[75100]:     <apic/>
Nov 13 17:37:15 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:37:15 user nova-compute[75100]:   </features>
Nov 13 17:37:15 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:37:15 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:37:15 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:37:15 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:37:15 user nova-compute[75100]:   </clock>
Nov 13 17:37:15 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:37:15 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:37:15 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:37:15 user nova-compute[75100]:   </cpu>
Nov 13 17:37:15 user nova-compute[75100]:   <devices>
Nov 13 17:37:15 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:37:15 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:37:15 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk"/>
Nov 13 17:37:15 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:37:15 user nova-compute[75100]:     </disk>
Nov 13 17:37:15 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:37:15 user nova-compute[75100]:       <mac address="fa:16:3e:84:df:da"/>
Nov 13 17:37:15 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:37:15 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:37:15 user nova-compute[75100]:       <target dev="tapbde2a813-77"/>
Nov 13 17:37:15 user nova-compute[75100]:     </interface>
Nov 13 17:37:15 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:37:15 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/console.log" append="off"/>
Nov 13 17:37:15 user nova-compute[75100]:     </serial>
Nov 13 17:37:15 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:37:15 user nova-compute[75100]:     <video>
Nov 13 17:37:15 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:37:15 user nova-compute[75100]:     </video>
Nov 13 17:37:15 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:37:15 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:37:15 user nova-compute[75100]:     </rng>
Nov 13 17:37:15 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:37:15 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:37:15 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:37:15 user nova-compute[75100]:     </memballoon>
Nov 13 17:37:15 user nova-compute[75100]:   </devices>
Nov 13 17:37:15 user nova-compute[75100]: </domain>
Nov 13 17:37:15 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:37:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-271909253',display_name='tempest-TestMinimumBasicScenario-server-271909253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-271909253',id=36,image_ref='a5e8ded8-4c58-4f04-aeea-b6e9452780d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/jb2gAq4MPFGLmeCSDS7e2R6FXMvVNiV2zxrLc46Ggp78cgynx93QfCXmvNb38jvNvbInYQwlwoBXg3gXv0yoVr1YOUrhIS0tHT/r2eWJO3p9j9SA4XHdo6+7SPcSXaQ==',key_name='tempest-TestMinimumBasicScenario-863798775',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dca12c426d0c495b80b77b8ae26be4eb',ramdisk_id='',reservation_id='r-4scowcic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a5e8ded8-4c58-4f04-aeea-b6e9452780d1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1769966982',owner_user_name='tempest-TestMinimumBasicScenario-1769966982-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:37:11Z,user_data=None,user_id='2ba71ec67c664e94a71cc9f9107303a5',uuid=6c6dba6f-fa48-4d7f-a529-d0215f251fc2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converting VIF {"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:df:da,bridge_name='br-int',has_traffic_filtering=True,id=bde2a813-7715-4fc1-a99e-f3cc8484988b,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde2a813-77') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG os_vif [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:df:da,bridge_name='br-int',has_traffic_filtering=True,id=bde2a813-7715-4fc1-a99e-f3cc8484988b,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde2a813-77') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9acd9ea6-3f22-5002-b03b-f297e1841ae0', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbde2a813-77, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbde2a813-77, col_values=(('qos', UUID('d88e1c81-2272-41e6-bc7d-c14224cadf99')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbde2a813-77, col_values=(('external_ids', {'iface-id': 'bde2a813-7715-4fc1-a99e-f3cc8484988b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:df:da', 'vm-uuid': '6c6dba6f-fa48-4d7f-a529-d0215f251fc2'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:15 user nova-compute[75100]: INFO os_vif [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:df:da,bridge_name='br-int',has_traffic_filtering=True,id=bde2a813-7715-4fc1-a99e-f3cc8484988b,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde2a813-77')
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:37:15 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] No VIF found with MAC fa:16:3e:84:df:da, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:37:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-be1a6734-989f-4346-860e-bc6927d9ccae req-b7a8c655-48ec-47ae-bd00-22a1eb52dafa service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-changed-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-be1a6734-989f-4346-860e-bc6927d9ccae req-b7a8c655-48ec-47ae-bd00-22a1eb52dafa service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Refreshing instance network info cache due to event network-changed-bde2a813-7715-4fc1-a99e-f3cc8484988b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:37:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-be1a6734-989f-4346-860e-bc6927d9ccae req-b7a8c655-48ec-47ae-bd00-22a1eb52dafa service nova] Acquiring lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:37:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-be1a6734-989f-4346-860e-bc6927d9ccae req-b7a8c655-48ec-47ae-bd00-22a1eb52dafa service nova] Acquired lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:37:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-be1a6734-989f-4346-860e-bc6927d9ccae req-b7a8c655-48ec-47ae-bd00-22a1eb52dafa service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Refreshing network info cache for port bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:37:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-198481ca-08d2-4f7e-859b-fcbc714425a7 req-4a1ad484-eb73-4cf4-9117-2c4cf4dd0ae5 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-198481ca-08d2-4f7e-859b-fcbc714425a7 req-4a1ad484-eb73-4cf4-9117-2c4cf4dd0ae5 service nova] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-198481ca-08d2-4f7e-859b-fcbc714425a7 req-4a1ad484-eb73-4cf4-9117-2c4cf4dd0ae5 service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-198481ca-08d2-4f7e-859b-fcbc714425a7 req-4a1ad484-eb73-4cf4-9117-2c4cf4dd0ae5 service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG nova.compute.manager [req-198481ca-08d2-4f7e-859b-fcbc714425a7 req-4a1ad484-eb73-4cf4-9117-2c4cf4dd0ae5 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] No waiting events found dispatching network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:17 user nova-compute[75100]: WARNING nova.compute.manager [req-198481ca-08d2-4f7e-859b-fcbc714425a7 req-4a1ad484-eb73-4cf4-9117-2c4cf4dd0ae5 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received unexpected event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b for instance with vm_state building and task_state spawning.
Nov 13 17:37:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-be1a6734-989f-4346-860e-bc6927d9ccae req-b7a8c655-48ec-47ae-bd00-22a1eb52dafa service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updated VIF entry in instance network info cache for port bde2a813-7715-4fc1-a99e-f3cc8484988b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG nova.network.neutron [req-be1a6734-989f-4346-860e-bc6927d9ccae req-b7a8c655-48ec-47ae-bd00-22a1eb52dafa service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updating instance_info_cache with network_info: [{"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-be1a6734-989f-4346-860e-bc6927d9ccae req-b7a8c655-48ec-47ae-bd00-22a1eb52dafa service nova] Releasing lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "81c970a1-23fd-4cda-a532-a40811e85e11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "81c970a1-23fd-4cda-a532-a40811e85e11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:37:18 user nova-compute[75100]: INFO nova.compute.claims [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Claim successful on node user
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-deleted-94abc659-a0f6-42ce-815c-5aea10c1d2d9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:18 user nova-compute[75100]: INFO nova.compute.manager [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Neutron deleted interface 94abc659-a0f6-42ce-815c-5aea10c1d2d9; detaching it from the instance and deleting it from the info cache
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.network.neutron [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [{"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "address": "fa:16:3e:9e:b5:77", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.82", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d615688-8a", "ovs_interfaceid": "1d615688-8ac5-49d1-8497-d846c7cd21b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Detach interface failed, port_id=94abc659-a0f6-42ce-815c-5aea10c1d2d9, reason: Instance 640d6233-140a-4bf0-8155-c309e75cfc1b could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-deleted-1d615688-8ac5-49d1-8497-d846c7cd21b6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:18 user nova-compute[75100]: INFO nova.compute.manager [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Neutron deleted interface 1d615688-8ac5-49d1-8497-d846c7cd21b6; detaching it from the instance and deleting it from the info cache
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.network.neutron [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [{"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "cbd8d867-99b0-467a-90e5-8f987740ad12", "address": "fa:16:3e:27:df:01", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbd8d867-99", "ovs_interfaceid": "cbd8d867-99b0-467a-90e5-8f987740ad12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Detach interface failed, port_id=1d615688-8ac5-49d1-8497-d846c7cd21b6, reason: Instance 640d6233-140a-4bf0-8155-c309e75cfc1b could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-deleted-cbd8d867-99b0-467a-90e5-8f987740ad12 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:18 user nova-compute[75100]: INFO nova.compute.manager [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Neutron deleted interface cbd8d867-99b0-467a-90e5-8f987740ad12; detaching it from the instance and deleting it from the info cache
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.network.neutron [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [{"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9063a069-2e42-4058-8355-98ab31c555f1", "address": "fa:16:3e:6f:92:c6", "network": {"id": "19dd5c66-bb3a-4a57-bea9-7dcc1df78b99", "bridge": "br-int", "label": "tempest-device-tagging-net2-700862042", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9063a069-2e", "ovs_interfaceid": "9063a069-2e42-4058-8355-98ab31c555f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Detach interface failed, port_id=cbd8d867-99b0-467a-90e5-8f987740ad12, reason: Instance 640d6233-140a-4bf0-8155-c309e75cfc1b could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:37:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-deleted-9063a069-2e42-4058-8355-98ab31c555f1 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:18 user nova-compute[75100]: INFO nova.compute.manager [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Neutron deleted interface 9063a069-2e42-4058-8355-98ab31c555f1; detaching it from the instance and deleting it from the info cache
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [{"id": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "address": "fa:16:3e:ff:09:ef", "network": {"id": "55829031-6f7b-434b-9a1a-5098c061235a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1668362229-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff6ba9bf-a2", "ovs_interfaceid": "ff6ba9bf-a2e8-410f-aff9-0820512938f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0834a216-c9af-4a33-bcdf-3c214e52e109", "address": "fa:16:3e:ae:8d:54", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0834a216-c9", "ovs_interfaceid": "0834a216-c9af-4a33-bcdf-3c214e52e109", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "address": "fa:16:3e:e3:49:a3", "network": {"id": "d24710ae-beb0-417c-974c-c9bfb85b7732", "bridge": "br-int", "label": "tempest-device-tagging-net1-2071737844", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.167", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1590c0bc0e2d44f89729b0ae32904fcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3849db2d-85", "ovs_interfaceid": "3849db2d-8539-4a60-a828-f0167e4ffd8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-352c5905-2ed5-41b7-bddd-8e1c064728b9 req-bb0f6171-298c-4530-92cb-7b81af810bb5 service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Detach interface failed, port_id=9063a069-2e42-4058-8355-98ab31c555f1, reason: Instance 640d6233-140a-4bf0-8155-c309e75cfc1b could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:37:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-8aba2add-d59c-41ae-ba3e-2e53ee4b2759 req-b961577a-d436-4577-aa0b-2d6f0750d6a0 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8aba2add-d59c-41ae-ba3e-2e53ee4b2759 req-b961577a-d436-4577-aa0b-2d6f0750d6a0 service nova] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8aba2add-d59c-41ae-ba3e-2e53ee4b2759 req-b961577a-d436-4577-aa0b-2d6f0750d6a0 service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8aba2add-d59c-41ae-ba3e-2e53ee4b2759 req-b961577a-d436-4577-aa0b-2d6f0750d6a0 service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-8aba2add-d59c-41ae-ba3e-2e53ee4b2759 req-b961577a-d436-4577-aa0b-2d6f0750d6a0 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] No waiting events found dispatching network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:19 user nova-compute[75100]: WARNING nova.compute.manager [req-8aba2add-d59c-41ae-ba3e-2e53ee4b2759 req-b961577a-d436-4577-aa0b-2d6f0750d6a0 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received unexpected event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b for instance with vm_state building and task_state spawning.
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:37:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Creating image(s)
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "/opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "/opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "/opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.policy [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fde156049464deba4b3a3125712baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6352bffe5fa144f996e2ba07f69f4ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:19 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Took 4.54 seconds to deallocate network for instance.
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.233s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Instance spawned successfully.
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.251s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:19 user nova-compute[75100]: INFO nova.compute.manager [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Took 9.14 seconds to spawn the instance on the hypervisor.
Nov 13 17:37:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk 1073741824" returned: 0 in 0.080s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:20 user nova-compute[75100]: INFO nova.compute.manager [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Took 10.21 seconds to build instance.
Nov 13 17:37:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-36d50f63-8b6b-45a5-9adf-ac43311a5f4f tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.322s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.233s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:20 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:37:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:20 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Cannot resize image /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:37:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:37:20 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Ensure instance console log exists: /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:37:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:20 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Successfully created port: 18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:37:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.compute.manager [req-b72d0962-9e78-49d9-a6e3-e47c6a61d21e req-3ee1497e-5200-4390-920d-4b183e4079dc service nova] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Received event network-vif-deleted-ff6ba9bf-a2e8-410f-aff9-0820512938f0 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Successfully updated port: 18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "refresh_cache-81c970a1-23fd-4cda-a532-a40811e85e11" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquired lock "refresh_cache-81c970a1-23fd-4cda-a532-a40811e85e11" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Updating instance_info_cache with network_info: [{"id": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "address": "fa:16:3e:74:57:cb", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18412885-d3", "ovs_interfaceid": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Releasing lock "refresh_cache-81c970a1-23fd-4cda-a532-a40811e85e11" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Instance network_info: |[{"id": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "address": "fa:16:3e:74:57:cb", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18412885-d3", "ovs_interfaceid": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Start _get_guest_xml network_info=[{"id": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "address": "fa:16:3e:74:57:cb", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18412885-d3", "ovs_interfaceid": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:37:21 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:37:21 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2006715285',display_name='tempest-AttachVolumeNegativeTest-server-2006715285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2006715285',id=37,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8gdeudjlRJt3GXF7/cRQLF1T6EAdTmZ5zmtPxD4NfmB/EF4igNsTcb475rMcjuKI7OqPdcI7xszWYmIrTrLZ7UcRrZr2qhDH5wHy1AgK12t3IxKhhqwACIq4q8H73vCw==',key_name='tempest-keypair-750520521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6352bffe5fa144f996e2ba07f69f4ee4',ramdisk_id='',reservation_id='r-3opii07q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2126330685',owner_user_name='tempest-AttachVolumeNegativeTest-2126330685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fde156049464deba4b3a3125712baa9',uuid=81c970a1-23fd-4cda-a532-a40811e85e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "address": "fa:16:3e:74:57:cb", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18412885-d3", "ovs_interfaceid": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converting VIF {"id": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "address": "fa:16:3e:74:57:cb", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18412885-d3", "ovs_interfaceid": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:57:cb,bridge_name='br-int',has_traffic_filtering=True,id=18412885-d3aa-422d-a8f7-eb1c96b1f0c8,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18412885-d3') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.objects.instance [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'pci_devices' on Instance uuid 81c970a1-23fd-4cda-a532-a40811e85e11 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:37:21 user nova-compute[75100]:   <uuid>81c970a1-23fd-4cda-a532-a40811e85e11</uuid>
Nov 13 17:37:21 user nova-compute[75100]:   <name>instance-00000025</name>
Nov 13 17:37:21 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:37:21 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:37:21 user nova-compute[75100]:   <metadata>
Nov 13 17:37:21 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:37:21 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:37:21 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2006715285</nova:name>
Nov 13 17:37:21 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:37:21</nova:creationTime>
Nov 13 17:37:21 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:37:21 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:37:21 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:37:21 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:37:21 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:37:21 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:37:21 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:37:21 user nova-compute[75100]:       <nova:owner>
Nov 13 17:37:21 user nova-compute[75100]:         <nova:user uuid="9fde156049464deba4b3a3125712baa9">tempest-AttachVolumeNegativeTest-2126330685-project-member</nova:user>
Nov 13 17:37:21 user nova-compute[75100]:         <nova:project uuid="6352bffe5fa144f996e2ba07f69f4ee4">tempest-AttachVolumeNegativeTest-2126330685</nova:project>
Nov 13 17:37:21 user nova-compute[75100]:       </nova:owner>
Nov 13 17:37:21 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:37:21 user nova-compute[75100]:       <nova:ports>
Nov 13 17:37:21 user nova-compute[75100]:         <nova:port uuid="18412885-d3aa-422d-a8f7-eb1c96b1f0c8">
Nov 13 17:37:21 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 17:37:21 user nova-compute[75100]:         </nova:port>
Nov 13 17:37:21 user nova-compute[75100]:       </nova:ports>
Nov 13 17:37:21 user nova-compute[75100]:     </nova:instance>
Nov 13 17:37:21 user nova-compute[75100]:   </metadata>
Nov 13 17:37:21 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:37:21 user nova-compute[75100]:     <system>
Nov 13 17:37:21 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:37:21 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:37:21 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:37:21 user nova-compute[75100]:       <entry name="serial">81c970a1-23fd-4cda-a532-a40811e85e11</entry>
Nov 13 17:37:21 user nova-compute[75100]:       <entry name="uuid">81c970a1-23fd-4cda-a532-a40811e85e11</entry>
Nov 13 17:37:21 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:37:21 user nova-compute[75100]:     </system>
Nov 13 17:37:21 user nova-compute[75100]:   </sysinfo>
Nov 13 17:37:21 user nova-compute[75100]:   <os>
Nov 13 17:37:21 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:37:21 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:37:21 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:37:21 user nova-compute[75100]:   </os>
Nov 13 17:37:21 user nova-compute[75100]:   <features>
Nov 13 17:37:21 user nova-compute[75100]:     <acpi/>
Nov 13 17:37:21 user nova-compute[75100]:     <apic/>
Nov 13 17:37:21 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:37:21 user nova-compute[75100]:   </features>
Nov 13 17:37:21 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:37:21 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:37:21 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:37:21 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:37:21 user nova-compute[75100]:   </clock>
Nov 13 17:37:21 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:37:21 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:37:21 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:37:21 user nova-compute[75100]:   </cpu>
Nov 13 17:37:21 user nova-compute[75100]:   <devices>
Nov 13 17:37:21 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:37:21 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:37:21 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk"/>
Nov 13 17:37:21 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:37:21 user nova-compute[75100]:     </disk>
Nov 13 17:37:21 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:37:21 user nova-compute[75100]:       <mac address="fa:16:3e:74:57:cb"/>
Nov 13 17:37:21 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:37:21 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:37:21 user nova-compute[75100]:       <target dev="tap18412885-d3"/>
Nov 13 17:37:21 user nova-compute[75100]:     </interface>
Nov 13 17:37:21 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:37:21 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/console.log" append="off"/>
Nov 13 17:37:21 user nova-compute[75100]:     </serial>
Nov 13 17:37:21 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:37:21 user nova-compute[75100]:     <video>
Nov 13 17:37:21 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:37:21 user nova-compute[75100]:     </video>
Nov 13 17:37:21 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:37:21 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:37:21 user nova-compute[75100]:     </rng>
Nov 13 17:37:21 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:37:21 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:37:21 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:37:21 user nova-compute[75100]:     </memballoon>
Nov 13 17:37:21 user nova-compute[75100]:   </devices>
Nov 13 17:37:21 user nova-compute[75100]: </domain>
Nov 13 17:37:21 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2006715285',display_name='tempest-AttachVolumeNegativeTest-server-2006715285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2006715285',id=37,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8gdeudjlRJt3GXF7/cRQLF1T6EAdTmZ5zmtPxD4NfmB/EF4igNsTcb475rMcjuKI7OqPdcI7xszWYmIrTrLZ7UcRrZr2qhDH5wHy1AgK12t3IxKhhqwACIq4q8H73vCw==',key_name='tempest-keypair-750520521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6352bffe5fa144f996e2ba07f69f4ee4',ramdisk_id='',reservation_id='r-3opii07q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2126330685',owner_user_name='tempest-AttachVolumeNegativeTest-2126330685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:37:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fde156049464deba4b3a3125712baa9',uuid=81c970a1-23fd-4cda-a532-a40811e85e11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "address": "fa:16:3e:74:57:cb", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18412885-d3", "ovs_interfaceid": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converting VIF {"id": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "address": "fa:16:3e:74:57:cb", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18412885-d3", "ovs_interfaceid": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:57:cb,bridge_name='br-int',has_traffic_filtering=True,id=18412885-d3aa-422d-a8f7-eb1c96b1f0c8,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18412885-d3') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG os_vif [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:57:cb,bridge_name='br-int',has_traffic_filtering=True,id=18412885-d3aa-422d-a8f7-eb1c96b1f0c8,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18412885-d3') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a78685a1-5afc-57ac-a71c-36ed0c00893a', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18412885-d3, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18412885-d3, col_values=(('qos', UUID('c2fb7641-8ed4-41a5-a0a0-a6de1737d81c')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18412885-d3, col_values=(('external_ids', {'iface-id': '18412885-d3aa-422d-a8f7-eb1c96b1f0c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:57:cb', 'vm-uuid': '81c970a1-23fd-4cda-a532-a40811e85e11'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:21 user nova-compute[75100]: INFO os_vif [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:57:cb,bridge_name='br-int',has_traffic_filtering=True,id=18412885-d3aa-422d-a8f7-eb1c96b1f0c8,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18412885-d3')
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:37:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No VIF found with MAC fa:16:3e:74:57:cb, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:37:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:22 user nova-compute[75100]: INFO nova.compute.manager [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Terminating instance
Nov 13 17:37:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:37:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Received event network-changed-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Refreshing instance network info cache due to event network-changed-18412885-d3aa-422d-a8f7-eb1c96b1f0c8. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] Acquiring lock "refresh_cache-81c970a1-23fd-4cda-a532-a40811e85e11" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] Acquired lock "refresh_cache-81c970a1-23fd-4cda-a532-a40811e85e11" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Refreshing network info cache for port 18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:37:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Instance destroyed successfully.
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.objects.instance [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'resources' on Instance uuid 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:31:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-651335238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-651335238',id=32,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-io0vancg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:35:36Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "address": "fa:16:3e:b0:5b:8d", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba1c3e90-56", "ovs_interfaceid": "ba1c3e90-566f-4b88-8f8c-1b100eea3621", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=ba1c3e90-566f-4b88-8f8c-1b100eea3621,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1c3e90-56') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_vif [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=ba1c3e90-566f-4b88-8f8c-1b100eea3621,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1c3e90-56') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba1c3e90-56, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adddd62d-05d8-40b3-8564-81a5320db764) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:23 user nova-compute[75100]: INFO os_vif [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5b:8d,bridge_name='br-int',has_traffic_filtering=True,id=ba1c3e90-566f-4b88-8f8c-1b100eea3621,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba1c3e90-56')
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXwpEWvf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:37:23 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb00a4c-f5c6-4b34-9beb-c6b018836629]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:37:23 user nova-compute[75100]: No targets found.
Nov 13 17:37:23 user nova-compute[75100]: iSNS:
Nov 13 17:37:23 user nova-compute[75100]: No targets found.
Nov 13 17:37:23 user nova-compute[75100]: STATIC:
Nov 13 17:37:23 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:37:23 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:23 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:23 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f
Nov 13 17:37:23 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:23 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:23 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea
Nov 13 17:37:23 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:23 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:23 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b
Nov 13 17:37:23 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:23 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:23 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:37:23 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:23 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:23 user nova-compute[75100]: FIRMWARE:
Nov 13 17:37:23 user nova-compute[75100]: No targets found.
Nov 13 17:37:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:37:23 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:37:23 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe01bbf-4e22-428a-9dc5-1cd8480b1f41]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de8ce4f-ccf8-4169-8a1a-563738ce2faf]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:23 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:37:23 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:23 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:23 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:23 user nova-compute[75100]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea (non-flash)
Nov 13 17:37:23 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:23 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:23 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c3d2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea'): ({'sdf'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Removing single pathed devices sdf {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:23 user nova-compute[75100]: INFO nova.compute.manager [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] [instance: 640d6233-140a-4bf0-8155-c309e75cfc1b] Took 4.11 seconds to detach 3 volumes for instance.
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d629ebf-9d40-4e84-8172-ac35905d7685]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94ef843-137d-4a0f-a9ed-9bea93a7dfd4]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flushing IO for device /dev/sdf {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aa14ae-398d-4db2-b0b7-32e1f7e03a56]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9853ec-2783-4880-8ed5-00b5ba8b0b1e]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] SCSI volumes sdf have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d54ce4-97b4-4a3f-82ea-1838c29427c5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Updated VIF entry in instance network info cache for port 18412885-d3aa-422d-a8f7-eb1c96b1f0c8. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Updating instance_info_cache with network_info: [{"id": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "address": "fa:16:3e:74:57:cb", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18412885-d3", "ovs_interfaceid": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[903b6f65-fb98-415a-bae9-4017c144534a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea, portal: 172.16.0.220,3260]
Nov 13 17:37:23 user nova-compute[75100]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea, portal: 172.16.0.220,3260] successful.
Nov 13 17:37:23 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] Releasing lock "refresh_cache-81c970a1-23fd-4cda-a532-a40811e85e11" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-unplugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] No waiting events found dispatching network-vif-unplugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-unplugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] Acquiring lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] No waiting events found dispatching network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:23 user nova-compute[75100]: WARNING nova.compute.manager [req-0398bd70-1cdc-41ea-845d-13f7b0c0b8f0 req-14fa3e6a-1101-4219-b21a-a025d605264b service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received unexpected event network-vif-plugged-ba1c3e90-566f-4b88-8f8c-1b100eea3621 for instance with vm_state active and task_state deleting.
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:535e4944-841b-4ec9-bf5a-75871b15f6ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[956aa3ed-49c8-4d9f-907b-a64140449a41]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.505s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] <== disconnect_volume: return (510ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:37:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:37:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Deleting instance files /opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2_del
Nov 13 17:37:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Deletion of /opt/stack/data/nova/instances/3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2_del complete
Nov 13 17:37:24 user nova-compute[75100]: INFO nova.compute.manager [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Took 1.87 seconds to destroy the instance on the hypervisor.
Nov 13 17:37:24 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:24 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Deleted allocations for instance 640d6233-140a-4bf0-8155-c309e75cfc1b
Nov 13 17:37:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0116a1a4-c51d-4db0-8a74-b31dcbe452cf tempest-TaggedBootDevicesTest_v242-1067443993 tempest-TaggedBootDevicesTest_v242-1067443993-project-member] Lock "640d6233-140a-4bf0-8155-c309e75cfc1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.394s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:24 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:37:24 user nova-compute[75100]: INFO nova.compute.claims [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Claim successful on node user
Nov 13 17:37:24 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:24 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Took 0.69 seconds to deallocate network for instance.
Nov 13 17:37:25 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-dccbe8a3-7213-4647-bbaa-15381f5eafaa req-eed4174c-6f63-4056-9f7e-7522c8626637 service nova] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Received event network-vif-deleted-ba1c3e90-566f-4b88-8f8c-1b100eea3621 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:37:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:37:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG nova.policy [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '380d78e868b44598aa311630ce34e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047cedafb8344129a644233034fef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:37:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Creating image(s)
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "/opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "/opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:25 user nova-compute[75100]: INFO nova.compute.manager [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2] Took 0.85 seconds to detach 1 volumes for instance.
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.237s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk 1073741824" returned: 0 in 0.050s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Successfully created port: fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.235s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 82968316-e313-4679-a853-f0d79e988c47 is timed out.
Nov 13 17:37:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully detached device vdb from instance 82968316-e313-4679-a853-f0d79e988c47 from the live domain config.
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.730s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Cannot resize image /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Ensure instance console log exists: /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bDnwKmFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:37:26 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "73c5d863-7cae-481f-b8ea-dfc217514658" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:26 user nova-compute[75100]: INFO nova.compute.manager [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Terminating instance
Nov 13 17:37:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Instance spawned successfully.
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c01c44d-0caa-4d0c-b06e-4a9028628811]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:37:26 user nova-compute[75100]: No targets found.
Nov 13 17:37:26 user nova-compute[75100]: iSNS:
Nov 13 17:37:26 user nova-compute[75100]: No targets found.
Nov 13 17:37:26 user nova-compute[75100]: STATIC:
Nov 13 17:37:26 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:37:26 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:26 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:26 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f
Nov 13 17:37:26 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:26 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:26 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b
Nov 13 17:37:26 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:26 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:26 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:37:26 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:26 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:26 user nova-compute[75100]: FIRMWARE:
Nov 13 17:37:26 user nova-compute[75100]: No targets found.
Nov 13 17:37:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:37:26 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:37:26 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad71e213-0bf8-47dc-9e16-d454204bc65b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:26 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Deleted allocations for instance 3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39f9722-5a75-443d-9b03-07fbad3b2e1b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:26 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:26 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:26 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:26 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:26 user nova-compute[75100]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b (non-flash)
Nov 13 17:37:26 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c4c1090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e8e675-ced1-4e76-aae2-4dde3a601fa6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[187539c1-8228-48d5-822e-c4e4558d27fc]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:26 user nova-compute[75100]: INFO nova.compute.manager [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Took 7.36 seconds to spawn the instance on the hypervisor.
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.036s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47e020f-4cd4-426c-93c0-91cca15da731]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadd8f9c-89cf-4470-8d4f-8043622eb8e7]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-df33f477-cfed-4b2d-b0f6-4355277e0f22 tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "3f125bd6-b1f9-4807-b3e3-e5932c1b4dc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.577s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[04174377-7f24-4dfe-bde3-b5e1a82a66c1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:26 user nova-compute[75100]: INFO nova.compute.manager [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Took 8.17 seconds to build instance.
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8e8a170c-8d73-43b0-a088-3cdb407e3202 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "81c970a1-23fd-4cda-a532-a40811e85e11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.322s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8758893b-cd36-4b7f-bb65-bc710489614f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b, portal: 172.16.0.220,3260]
Nov 13 17:37:26 user nova-compute[75100]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b, portal: 172.16.0.220,3260] successful.
Nov 13 17:37:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4402ee3-4989-4200-8425-e4cbe6b6530b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0e7797-14fc-41c5-8037-1cca5d364b03]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.470s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] <== disconnect_volume: return (471ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:27 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Instance destroyed successfully.
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lazy-loading 'resources' on Instance uuid 73c5d863-7cae-481f-b8ea-dfc217514658 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Successfully updated port: fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:30:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-95005404',display_name='tempest-ServerActionsTestOtherA-server-95005404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-95005404',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArXX8H/F/4k/bCD26MQyJfYc6kVyijAa21ATX3s9SJ4y/SgOLDqvjWXABytQ7Y0rezN8922Yqg0PmzPzy90j9+erJSCwuQJnigd+guQkVWmuyFrLUQ16eK1oB+ijXr+Rw==',key_name='tempest-keypair-216019137',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:32:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-g1hxuk35',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=73c5d863-7cae-481f-b8ea-dfc217514658,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "address": "fa:16:3e:e9:c5:34", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbcd619-e7", "ovs_interfaceid": "abbcd619-e7dc-4dd0-b1a4-4c542462c321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_vif [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-3661a991-9474-431d-b578-946012f3f131 req-8767f74a-a1ca-4e52-a754-6349b469fdb6 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received event network-vif-unplugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3661a991-9474-431d-b578-946012f3f131 req-8767f74a-a1ca-4e52-a754-6349b469fdb6 service nova] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3661a991-9474-431d-b578-946012f3f131 req-8767f74a-a1ca-4e52-a754-6349b469fdb6 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3661a991-9474-431d-b578-946012f3f131 req-8767f74a-a1ca-4e52-a754-6349b469fdb6 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-3661a991-9474-431d-b578-946012f3f131 req-8767f74a-a1ca-4e52-a754-6349b469fdb6 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] No waiting events found dispatching network-vif-unplugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-3661a991-9474-431d-b578-946012f3f131 req-8767f74a-a1ca-4e52-a754-6349b469fdb6 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received event network-vif-unplugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabbcd619-e7, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "refresh_cache-f0bf103e-23eb-486a-a5df-9f3e66d4d076" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquired lock "refresh_cache-f0bf103e-23eb-486a-a5df-9f3e66d4d076" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56257d8f-aef0-4417-879e-b236d3d438f8) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:27 user nova-compute[75100]: INFO os_vif [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c5:34,bridge_name='br-int',has_traffic_filtering=True,id=abbcd619-e7dc-4dd0-b1a4-4c542462c321,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbcd619-e7')
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CZlmQkVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:37:27 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.041s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c48adb5-63cb-42f6-8b01-9c01719021ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:37:27 user nova-compute[75100]: No targets found.
Nov 13 17:37:27 user nova-compute[75100]: iSNS:
Nov 13 17:37:27 user nova-compute[75100]: No targets found.
Nov 13 17:37:27 user nova-compute[75100]: STATIC:
Nov 13 17:37:27 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:37:27 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:27 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:27 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f
Nov 13 17:37:27 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:27 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:27 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23
Nov 13 17:37:27 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:27 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:27 user nova-compute[75100]: FIRMWARE:
Nov 13 17:37:27 user nova-compute[75100]: No targets found.
Nov 13 17:37:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:37:27 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:37:27 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[debc1d54-ff54-4889-8904-f8182db1e25b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf268690-dff3-4ecb-b1a7-f29a1ad0cda2]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:27 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:27 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:27 user nova-compute[75100]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 (non-flash)
Nov 13 17:37:27 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38dd3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[55af1f83-9783-4197-b095-1850487875a2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[17213fcf-0680-4122-889c-15fab2e611eb]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa713bf1-cc0b-4f08-a7e1-90ea44199eaf]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc4eb28-7840-41fb-93a1-3a87cc0f06ac]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e66aaf9-b2f8-4533-8d62-2d79297d0084]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ee7550-fdb9-4e08-b06d-d8c5abf1ffe3]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260]
Nov 13 17:37:27 user nova-compute[75100]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23, portal: 172.16.0.220,3260] successful.
Nov 13 17:37:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-e3195123-ecad-46c5-9533-2e14d51be956 req-fc603923-0a2a-4d4f-8175-b1a46354e63e service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Received event network-vif-plugged-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e3195123-ecad-46c5-9533-2e14d51be956 req-fc603923-0a2a-4d4f-8175-b1a46354e63e service nova] Acquiring lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e3195123-ecad-46c5-9533-2e14d51be956 req-fc603923-0a2a-4d4f-8175-b1a46354e63e service nova] Lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e3195123-ecad-46c5-9533-2e14d51be956 req-fc603923-0a2a-4d4f-8175-b1a46354e63e service nova] Lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-e3195123-ecad-46c5-9533-2e14d51be956 req-fc603923-0a2a-4d4f-8175-b1a46354e63e service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] No waiting events found dispatching network-vif-plugged-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:27 user nova-compute[75100]: WARNING nova.compute.manager [req-e3195123-ecad-46c5-9533-2e14d51be956 req-fc603923-0a2a-4d4f-8175-b1a46354e63e service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Received unexpected event network-vif-plugged-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 for instance with vm_state active and task_state None.
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f577ba-2aaa-4622-8530-3e5461d39c23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e62ef0a-dc2b-4477-b24a-f2179a39e746]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] <== disconnect_volume: return (387ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:37:27 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Deleting instance files /opt/stack/data/nova/instances/73c5d863-7cae-481f-b8ea-dfc217514658_del
Nov 13 17:37:27 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Deletion of /opt/stack/data/nova/instances/73c5d863-7cae-481f-b8ea-dfc217514658_del complete
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Updating instance_info_cache with network_info: [{"id": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "address": "fa:16:3e:e1:f3:58", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5bea88-fe", "ovs_interfaceid": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Releasing lock "refresh_cache-f0bf103e-23eb-486a-a5df-9f3e66d4d076" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Instance network_info: |[{"id": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "address": "fa:16:3e:e1:f3:58", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5bea88-fe", "ovs_interfaceid": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Start _get_guest_xml network_info=[{"id": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "address": "fa:16:3e:e1:f3:58", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5bea88-fe", "ovs_interfaceid": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:37:27 user nova-compute[75100]: INFO nova.compute.manager [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:37:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:37:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1869687129',display_name='tempest-ServersNegativeTestJSON-server-1869687129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1869687129',id=38,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='047cedafb8344129a644233034fef4f4',ramdisk_id='',reservation_id='r-zd0a9bbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1990231420',owner_user_name='tempest-ServersNegativeTestJSON-1990231420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:37:25Z,user_data=None,user_id='380d78e868b44598aa311630ce34e0d1',uuid=f0bf103e-23eb-486a-a5df-9f3e66d4d076,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "address": "fa:16:3e:e1:f3:58", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5bea88-fe", "ovs_interfaceid": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Converting VIF {"id": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "address": "fa:16:3e:e1:f3:58", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5bea88-fe", "ovs_interfaceid": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=fd5bea88-fef0-4963-bb8f-4aaf5be02ef5,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5bea88-fe') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.objects.instance [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lazy-loading 'pci_devices' on Instance uuid f0bf103e-23eb-486a-a5df-9f3e66d4d076 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.objects.instance [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid 82968316-e313-4679-a853-f0d79e988c47 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:37:27 user nova-compute[75100]:   <uuid>f0bf103e-23eb-486a-a5df-9f3e66d4d076</uuid>
Nov 13 17:37:27 user nova-compute[75100]:   <name>instance-00000026</name>
Nov 13 17:37:27 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:37:27 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:37:27 user nova-compute[75100]:   <metadata>
Nov 13 17:37:27 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:37:27 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:37:27 user nova-compute[75100]:       <nova:name>tempest-ServersNegativeTestJSON-server-1869687129</nova:name>
Nov 13 17:37:27 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:37:27</nova:creationTime>
Nov 13 17:37:27 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:37:27 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:37:27 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:37:27 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:37:27 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:37:27 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:37:27 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:37:27 user nova-compute[75100]:       <nova:owner>
Nov 13 17:37:27 user nova-compute[75100]:         <nova:user uuid="380d78e868b44598aa311630ce34e0d1">tempest-ServersNegativeTestJSON-1990231420-project-member</nova:user>
Nov 13 17:37:27 user nova-compute[75100]:         <nova:project uuid="047cedafb8344129a644233034fef4f4">tempest-ServersNegativeTestJSON-1990231420</nova:project>
Nov 13 17:37:27 user nova-compute[75100]:       </nova:owner>
Nov 13 17:37:27 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:37:27 user nova-compute[75100]:       <nova:ports>
Nov 13 17:37:27 user nova-compute[75100]:         <nova:port uuid="fd5bea88-fef0-4963-bb8f-4aaf5be02ef5">
Nov 13 17:37:27 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 17:37:27 user nova-compute[75100]:         </nova:port>
Nov 13 17:37:27 user nova-compute[75100]:       </nova:ports>
Nov 13 17:37:27 user nova-compute[75100]:     </nova:instance>
Nov 13 17:37:27 user nova-compute[75100]:   </metadata>
Nov 13 17:37:27 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:37:27 user nova-compute[75100]:     <system>
Nov 13 17:37:27 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:37:27 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:37:27 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:37:27 user nova-compute[75100]:       <entry name="serial">f0bf103e-23eb-486a-a5df-9f3e66d4d076</entry>
Nov 13 17:37:27 user nova-compute[75100]:       <entry name="uuid">f0bf103e-23eb-486a-a5df-9f3e66d4d076</entry>
Nov 13 17:37:27 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:37:27 user nova-compute[75100]:     </system>
Nov 13 17:37:27 user nova-compute[75100]:   </sysinfo>
Nov 13 17:37:27 user nova-compute[75100]:   <os>
Nov 13 17:37:27 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:37:27 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:37:27 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:37:27 user nova-compute[75100]:   </os>
Nov 13 17:37:27 user nova-compute[75100]:   <features>
Nov 13 17:37:27 user nova-compute[75100]:     <acpi/>
Nov 13 17:37:27 user nova-compute[75100]:     <apic/>
Nov 13 17:37:27 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:37:27 user nova-compute[75100]:   </features>
Nov 13 17:37:27 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:37:27 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:37:27 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:37:27 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:37:27 user nova-compute[75100]:   </clock>
Nov 13 17:37:27 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:37:27 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:37:27 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:37:27 user nova-compute[75100]:   </cpu>
Nov 13 17:37:27 user nova-compute[75100]:   <devices>
Nov 13 17:37:27 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:37:27 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:37:27 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk"/>
Nov 13 17:37:27 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:37:27 user nova-compute[75100]:     </disk>
Nov 13 17:37:27 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:37:27 user nova-compute[75100]:       <mac address="fa:16:3e:e1:f3:58"/>
Nov 13 17:37:27 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:37:27 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:37:27 user nova-compute[75100]:       <target dev="tapfd5bea88-fe"/>
Nov 13 17:37:27 user nova-compute[75100]:     </interface>
Nov 13 17:37:27 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:37:27 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/console.log" append="off"/>
Nov 13 17:37:27 user nova-compute[75100]:     </serial>
Nov 13 17:37:27 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:37:27 user nova-compute[75100]:     <video>
Nov 13 17:37:27 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:37:27 user nova-compute[75100]:     </video>
Nov 13 17:37:27 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:37:27 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:37:27 user nova-compute[75100]:     </rng>
Nov 13 17:37:27 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:37:27 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:37:27 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:37:27 user nova-compute[75100]:     </memballoon>
Nov 13 17:37:27 user nova-compute[75100]:   </devices>
Nov 13 17:37:27 user nova-compute[75100]: </domain>
Nov 13 17:37:27 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1869687129',display_name='tempest-ServersNegativeTestJSON-server-1869687129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1869687129',id=38,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='047cedafb8344129a644233034fef4f4',ramdisk_id='',reservation_id='r-zd0a9bbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1990231420',owner_user_name='tempest-ServersNegativeTestJSON-1990231420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:37:25Z,user_data=None,user_id='380d78e868b44598aa311630ce34e0d1',uuid=f0bf103e-23eb-486a-a5df-9f3e66d4d076,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "address": "fa:16:3e:e1:f3:58", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5bea88-fe", "ovs_interfaceid": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Converting VIF {"id": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "address": "fa:16:3e:e1:f3:58", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5bea88-fe", "ovs_interfaceid": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=fd5bea88-fef0-4963-bb8f-4aaf5be02ef5,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5bea88-fe') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG os_vif [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=fd5bea88-fef0-4963-bb8f-4aaf5be02ef5,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5bea88-fe') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ae7b1cb-d0a9-575b-865d-73b3655b74f7', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd5bea88-fe, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd5bea88-fe, col_values=(('qos', UUID('c64d12aa-294d-4374-9542-a13faf5ca0a1')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd5bea88-fe, col_values=(('external_ids', {'iface-id': 'fd5bea88-fef0-4963-bb8f-4aaf5be02ef5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:f3:58', 'vm-uuid': 'f0bf103e-23eb-486a-a5df-9f3e66d4d076'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:27 user nova-compute[75100]: INFO os_vif [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=fd5bea88-fef0-4963-bb8f-4aaf5be02ef5,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5bea88-fe')
Nov 13 17:37:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8bbd7a96-28ad-42e8-a4ef-a0b87bda4a05 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.177s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:37:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] No VIF found with MAC fa:16:3e:e1:f3:58, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:37:28 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:28 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Took 0.91 seconds to deallocate network for instance.
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:29 user nova-compute[75100]: INFO nova.compute.manager [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Detaching volume a2cbe300-6e47-472f-8a32-1850647e1b0f
Nov 13 17:37:29 user nova-compute[75100]: INFO nova.virt.block_device [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Attempting to driver detach volume a2cbe300-6e47-472f-8a32-1850647e1b0f from mountpoint /dev/vdc
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Attempting to detach device vdc from instance 82968316-e313-4679-a853-f0d79e988c47 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:37:29 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:37:29 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:37:29 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 13 17:37:29 user nova-compute[75100]:   <serial>a2cbe300-6e47-472f-8a32-1850647e1b0f</serial>
Nov 13 17:37:29 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 17:37:29 user nova-compute[75100]: </disk>
Nov 13 17:37:29 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:37:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully detached device vdc from instance 82968316-e313-4679-a853-f0d79e988c47 from the persistent domain config.
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 82968316-e313-4679-a853-f0d79e988c47 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:37:29 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:37:29 user nova-compute[75100]:   <source dev="/dev/sdg"/>
Nov 13 17:37:29 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 13 17:37:29 user nova-compute[75100]:   <serial>a2cbe300-6e47-472f-8a32-1850647e1b0f</serial>
Nov 13 17:37:29 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 17:37:29 user nova-compute[75100]: </disk>
Nov 13 17:37:29 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Received event network-changed-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Refreshing instance network info cache due to event network-changed-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] Acquiring lock "refresh_cache-f0bf103e-23eb-486a-a5df-9f3e66d4d076" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] Acquired lock "refresh_cache-f0bf103e-23eb-486a-a5df-9f3e66d4d076" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Refreshing network info cache for port fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-93d7c5cf-160d-4184-ba2a-a2f99826f39b req-bb8e0c18-f749-4e4e-9e30-4601c15fed49 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Received event network-vif-plugged-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-93d7c5cf-160d-4184-ba2a-a2f99826f39b req-bb8e0c18-f749-4e4e-9e30-4601c15fed49 service nova] Acquiring lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-93d7c5cf-160d-4184-ba2a-a2f99826f39b req-bb8e0c18-f749-4e4e-9e30-4601c15fed49 service nova] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-93d7c5cf-160d-4184-ba2a-a2f99826f39b req-bb8e0c18-f749-4e4e-9e30-4601c15fed49 service nova] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-93d7c5cf-160d-4184-ba2a-a2f99826f39b req-bb8e0c18-f749-4e4e-9e30-4601c15fed49 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] No waiting events found dispatching network-vif-plugged-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:29 user nova-compute[75100]: WARNING nova.compute.manager [req-93d7c5cf-160d-4184-ba2a-a2f99826f39b req-bb8e0c18-f749-4e4e-9e30-4601c15fed49 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Received unexpected event network-vif-plugged-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 for instance with vm_state building and task_state spawning.
Nov 13 17:37:29 user nova-compute[75100]: INFO nova.compute.manager [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Took 0.95 seconds to detach 1 volumes for instance.
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Deleting volume: b6f577ba-2aaa-4622-8530-3e5461d39c23 {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 82968316-e313-4679-a853-f0d79e988c47 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-f0ebe4f8-f60c-4d41-8f10-67a1f645ff0e req-698dc03d-084f-407a-aee0-ebc0f805a237 service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Received event network-vif-plugged-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f0ebe4f8-f60c-4d41-8f10-67a1f645ff0e req-698dc03d-084f-407a-aee0-ebc0f805a237 service nova] Acquiring lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f0ebe4f8-f60c-4d41-8f10-67a1f645ff0e req-698dc03d-084f-407a-aee0-ebc0f805a237 service nova] Lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f0ebe4f8-f60c-4d41-8f10-67a1f645ff0e req-698dc03d-084f-407a-aee0-ebc0f805a237 service nova] Lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-f0ebe4f8-f60c-4d41-8f10-67a1f645ff0e req-698dc03d-084f-407a-aee0-ebc0f805a237 service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] No waiting events found dispatching network-vif-plugged-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:29 user nova-compute[75100]: WARNING nova.compute.manager [req-f0ebe4f8-f60c-4d41-8f10-67a1f645ff0e req-698dc03d-084f-407a-aee0-ebc0f805a237 service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Received unexpected event network-vif-plugged-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 for instance with vm_state active and task_state None.
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Updated VIF entry in instance network info cache for port fd5bea88-fef0-4963-bb8f-4aaf5be02ef5. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.network.neutron [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Updating instance_info_cache with network_info: [{"id": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "address": "fa:16:3e:e1:f3:58", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5bea88-fe", "ovs_interfaceid": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] Releasing lock "refresh_cache-f0bf103e-23eb-486a-a5df-9f3e66d4d076" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received event network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] Acquiring lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] Lock "73c5d863-7cae-481f-b8ea-dfc217514658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] No waiting events found dispatching network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:29 user nova-compute[75100]: WARNING nova.compute.manager [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received unexpected event network-vif-plugged-abbcd619-e7dc-4dd0-b1a4-4c542462c321 for instance with vm_state active and task_state deleting.
Nov 13 17:37:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-c50c5194-0e6e-4135-9967-b87d5f99b60f req-eb769278-752f-4099-bc49-8a241c9bc867 service nova] [instance: 73c5d863-7cae-481f-b8ea-dfc217514658] Received event network-vif-deleted-abbcd619-e7dc-4dd0-b1a4-4c542462c321 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:37:30 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:37:30 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:37:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:30 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:37:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.723s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:30 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Deleted allocations for instance 73c5d863-7cae-481f-b8ea-dfc217514658
Nov 13 17:37:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b18333a-92da-45f4-917e-4c6ed665f90f tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "73c5d863-7cae-481f-b8ea-dfc217514658" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.302s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:37:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:37:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-08900860-5a7e-4f93-bfa4-bd368fea1484 req-e2718989-826b-4c0f-b38c-99b0138ed5b4 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Received event network-vif-plugged-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-08900860-5a7e-4f93-bfa4-bd368fea1484 req-e2718989-826b-4c0f-b38c-99b0138ed5b4 service nova] Acquiring lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-08900860-5a7e-4f93-bfa4-bd368fea1484 req-e2718989-826b-4c0f-b38c-99b0138ed5b4 service nova] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-08900860-5a7e-4f93-bfa4-bd368fea1484 req-e2718989-826b-4c0f-b38c-99b0138ed5b4 service nova] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-08900860-5a7e-4f93-bfa4-bd368fea1484 req-e2718989-826b-4c0f-b38c-99b0138ed5b4 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] No waiting events found dispatching network-vif-plugged-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:31 user nova-compute[75100]: WARNING nova.compute.manager [req-08900860-5a7e-4f93-bfa4-bd368fea1484 req-e2718989-826b-4c0f-b38c-99b0138ed5b4 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Received unexpected event network-vif-plugged-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 for instance with vm_state building and task_state spawning.
Nov 13 17:37:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:37:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:37:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:37:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:37:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Instance spawned successfully.
Nov 13 17:37:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:37:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:37:32 user nova-compute[75100]: INFO nova.compute.manager [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Took 7.53 seconds to spawn the instance on the hypervisor.
Nov 13 17:37:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:37:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:32 user nova-compute[75100]: INFO nova.compute.manager [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Took 8.50 seconds to build instance.
Nov 13 17:37:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47c2578f-fc46-46d3-8fc7-db3352f06d9a tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.642s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:37:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:37:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:37:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:37:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:37:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Updating instance_info_cache with network_info: [{"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-83d28254-9d5f-4190-85de-76f5a2b69dac" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:37:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:37:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:37:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:37:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:37 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:37:37 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:37:37 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8033MB free_disk=25.008468627929688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:37:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b0c1af59-f1bd-4c02-8843-e477cd7169d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 82968316-e313-4679-a853-f0d79e988c47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 81c970a1-23fd-4cda-a532-a40811e85e11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f0bf103e-23eb-486a-a5df-9f3e66d4d076 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:37:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.646s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:37:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:37:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:49 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 82968316-e313-4679-a853-f0d79e988c47 is timed out.
Nov 13 17:37:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully detached device vdc from instance 82968316-e313-4679-a853-f0d79e988c47 from the live domain config.
Nov 13 17:37:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLVGUbDp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:37:49 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe4cfdd-6049-4cc5-9a89-1de284401380]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:37:49 user nova-compute[75100]: No targets found.
Nov 13 17:37:49 user nova-compute[75100]: iSNS:
Nov 13 17:37:49 user nova-compute[75100]: No targets found.
Nov 13 17:37:49 user nova-compute[75100]: STATIC:
Nov 13 17:37:49 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:37:49 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:49 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:49 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f
Nov 13 17:37:49 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:37:49 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:37:49 user nova-compute[75100]: FIRMWARE:
Nov 13 17:37:49 user nova-compute[75100]: No targets found.
Nov 13 17:37:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:37:49 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:37:49 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4012ad72-2bac-442d-a555-6ab279fdeaf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bded7ca-1842-45a5-ae49-f786b612b457]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:49 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:37:49 user nova-compute[75100]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f (non-flash)
Nov 13 17:37:49 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38d42d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f'): ({'sdg'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Removing single pathed devices sdg {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2f781a-e3e1-49d2-909a-865862f89dfa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb85ea1a-825a-4be4-baa8-eb1c5005655d]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Flushing IO for device /dev/sdg {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece9e27d-d569-48c5-8874-732f5d375530]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7707d6-015e-4a61-966b-5a0970f9b346]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] SCSI volumes sdg have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d0718f-30c4-4271-a4b1-3fb6d46dbfa9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8f7144-f04c-413f-8702-78e16b53b625]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f, portal: 172.16.0.220,3260]
Nov 13 17:37:50 user nova-compute[75100]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f, portal: 172.16.0.220,3260] successful.
Nov 13 17:37:50 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2cbe300-6e47-472f-8a32-1850647e1b0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f3ba11-0c30-4a00-9c1e-0aa5815ee67d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] <== disconnect_volume: return (290ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG nova.objects.instance [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'flavor' on Instance uuid 82968316-e313-4679-a853-f0d79e988c47 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:37:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-93599a6e-c173-4e3b-8240-3a987ad6933f tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.798s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:52 user nova-compute[75100]: INFO nova.compute.manager [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Terminating instance
Nov 13 17:37:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-77ac63b5-ca8a-4e8a-8bfe-38bcc705a525 req-bed5460b-dd25-482c-8af9-17f28d33d444 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Received event network-vif-unplugged-e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-77ac63b5-ca8a-4e8a-8bfe-38bcc705a525 req-bed5460b-dd25-482c-8af9-17f28d33d444 service nova] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-77ac63b5-ca8a-4e8a-8bfe-38bcc705a525 req-bed5460b-dd25-482c-8af9-17f28d33d444 service nova] Lock "82968316-e313-4679-a853-f0d79e988c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-77ac63b5-ca8a-4e8a-8bfe-38bcc705a525 req-bed5460b-dd25-482c-8af9-17f28d33d444 service nova] Lock "82968316-e313-4679-a853-f0d79e988c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-77ac63b5-ca8a-4e8a-8bfe-38bcc705a525 req-bed5460b-dd25-482c-8af9-17f28d33d444 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] No waiting events found dispatching network-vif-unplugged-e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-77ac63b5-ca8a-4e8a-8bfe-38bcc705a525 req-bed5460b-dd25-482c-8af9-17f28d33d444 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Received event network-vif-unplugged-e77bf7da-0b83-48f1-838a-67925d77322b for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 82968316-e313-4679-a853-f0d79e988c47] Instance destroyed successfully.
Nov 13 17:37:53 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lazy-loading 'resources' on Instance uuid 82968316-e313-4679-a853-f0d79e988c47 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1956930601',display_name='tempest-AttachVolumeTestJSON-server-1956930601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1956930601',id=34,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr7L08OoGFa+sLiQRS2XxgVJF5grMGztpgx7PiiwqjSErrvScLDXhKgglG1Dz/IkGbs/w230R6ZcEFWmJgbgwW2kleHRr0IcuaNskNbPH4MHAyYMPAcf6uNQAAC6Pk7mQ==',key_name='tempest-keypair-1784707078',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:35:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43327ade8a814488bb141835e2ac331b',ramdisk_id='',reservation_id='r-3p8nqa6d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2091682056',owner_user_name='tempest-AttachVolumeTestJSON-2091682056-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:35:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='15122cbfe21b4775b679285eeb4beff7',uuid=82968316-e313-4679-a853-f0d79e988c47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e77bf7da-0b83-48f1-838a-67925d77322b", "address": "fa:16:3e:e8:37:0e", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77bf7da-0b", "ovs_interfaceid": "e77bf7da-0b83-48f1-838a-67925d77322b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converting VIF {"id": "e77bf7da-0b83-48f1-838a-67925d77322b", "address": "fa:16:3e:e8:37:0e", "network": {"id": "8a5d87df-2432-4a22-97c8-55c3200e0a29", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2079829571-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43327ade8a814488bb141835e2ac331b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape77bf7da-0b", "ovs_interfaceid": "e77bf7da-0b83-48f1-838a-67925d77322b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:37:0e,bridge_name='br-int',has_traffic_filtering=True,id=e77bf7da-0b83-48f1-838a-67925d77322b,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77bf7da-0b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG os_vif [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:37:0e,bridge_name='br-int',has_traffic_filtering=True,id=e77bf7da-0b83-48f1-838a-67925d77322b,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77bf7da-0b') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape77bf7da-0b, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af378e21-8c85-4760-aead-3484c973f499) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:53 user nova-compute[75100]: INFO os_vif [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:37:0e,bridge_name='br-int',has_traffic_filtering=True,id=e77bf7da-0b83-48f1-838a-67925d77322b,network=Network(8a5d87df-2432-4a22-97c8-55c3200e0a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape77bf7da-0b')
Nov 13 17:37:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Deleting instance files /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47_del
Nov 13 17:37:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Deletion of /opt/stack/data/nova/instances/82968316-e313-4679-a853-f0d79e988c47_del complete
Nov 13 17:37:53 user nova-compute[75100]: INFO nova.compute.manager [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] [instance: 82968316-e313-4679-a853-f0d79e988c47] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 17:37:53 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 82968316-e313-4679-a853-f0d79e988c47] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 82968316-e313-4679-a853-f0d79e988c47] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 82968316-e313-4679-a853-f0d79e988c47] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-4e328b38-2773-4640-8bd4-e270523452ad req-4c075fec-2ae7-4113-8955-9de27fd310bb service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Received event network-vif-deleted-e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:53 user nova-compute[75100]: INFO nova.compute.manager [req-4e328b38-2773-4640-8bd4-e270523452ad req-4c075fec-2ae7-4113-8955-9de27fd310bb service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Neutron deleted interface e77bf7da-0b83-48f1-838a-67925d77322b; detaching it from the instance and deleting it from the info cache
Nov 13 17:37:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-4e328b38-2773-4640-8bd4-e270523452ad req-4c075fec-2ae7-4113-8955-9de27fd310bb service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:37:53 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 82968316-e313-4679-a853-f0d79e988c47] Took 0.70 seconds to deallocate network for instance.
Nov 13 17:37:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-4e328b38-2773-4640-8bd4-e270523452ad req-4c075fec-2ae7-4113-8955-9de27fd310bb service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Detach interface failed, port_id=e77bf7da-0b83-48f1-838a-67925d77322b, reason: Instance 82968316-e313-4679-a853-f0d79e988c47 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:54 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:37:54 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:37:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:54 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Deleted allocations for instance 82968316-e313-4679-a853-f0d79e988c47
Nov 13 17:37:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a07c07a2-5957-48be-b444-b4ff81b81767 tempest-AttachVolumeTestJSON-2091682056 tempest-AttachVolumeTestJSON-2091682056-project-member] Lock "82968316-e313-4679-a853-f0d79e988c47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-150d1bab-1afd-4756-9643-294f2b833121 req-3996fed9-c5da-4b93-9559-abef47f5e6b2 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Received event network-vif-plugged-e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:37:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-150d1bab-1afd-4756-9643-294f2b833121 req-3996fed9-c5da-4b93-9559-abef47f5e6b2 service nova] Acquiring lock "82968316-e313-4679-a853-f0d79e988c47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:37:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-150d1bab-1afd-4756-9643-294f2b833121 req-3996fed9-c5da-4b93-9559-abef47f5e6b2 service nova] Lock "82968316-e313-4679-a853-f0d79e988c47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:37:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-150d1bab-1afd-4756-9643-294f2b833121 req-3996fed9-c5da-4b93-9559-abef47f5e6b2 service nova] Lock "82968316-e313-4679-a853-f0d79e988c47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:37:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-150d1bab-1afd-4756-9643-294f2b833121 req-3996fed9-c5da-4b93-9559-abef47f5e6b2 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] No waiting events found dispatching network-vif-plugged-e77bf7da-0b83-48f1-838a-67925d77322b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:37:54 user nova-compute[75100]: WARNING nova.compute.manager [req-150d1bab-1afd-4756-9643-294f2b833121 req-3996fed9-c5da-4b93-9559-abef47f5e6b2 service nova] [instance: 82968316-e313-4679-a853-f0d79e988c47] Received unexpected event network-vif-plugged-e77bf7da-0b83-48f1-838a-67925d77322b for instance with vm_state deleted and task_state None.
Nov 13 17:37:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:37:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:12 user nova-compute[75100]: INFO nova.compute.manager [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Terminating instance
Nov 13 17:38:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-b23ae390-32e5-47c9-ad5d-c3d090fd4bdd req-16de8ee0-0a9e-41a7-8d67-4444cbeb4b26 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Received event network-vif-unplugged-19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b23ae390-32e5-47c9-ad5d-c3d090fd4bdd req-16de8ee0-0a9e-41a7-8d67-4444cbeb4b26 service nova] Acquiring lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b23ae390-32e5-47c9-ad5d-c3d090fd4bdd req-16de8ee0-0a9e-41a7-8d67-4444cbeb4b26 service nova] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b23ae390-32e5-47c9-ad5d-c3d090fd4bdd req-16de8ee0-0a9e-41a7-8d67-4444cbeb4b26 service nova] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-b23ae390-32e5-47c9-ad5d-c3d090fd4bdd req-16de8ee0-0a9e-41a7-8d67-4444cbeb4b26 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] No waiting events found dispatching network-vif-unplugged-19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-b23ae390-32e5-47c9-ad5d-c3d090fd4bdd req-16de8ee0-0a9e-41a7-8d67-4444cbeb4b26 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Received event network-vif-unplugged-19a226f1-aa84-4dea-bd99-c1e740d75d57 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:13 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Instance destroyed successfully.
Nov 13 17:38:13 user nova-compute[75100]: DEBUG nova.objects.instance [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'resources' on Instance uuid 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:28:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-370499798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-370499798',id=25,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:28:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-pd3jvel2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:29:57Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "address": "fa:16:3e:72:9b:6a", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a226f1-aa", "ovs_interfaceid": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "address": "fa:16:3e:72:9b:6a", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19a226f1-aa", "ovs_interfaceid": "19a226f1-aa84-4dea-bd99-c1e740d75d57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:9b:6a,bridge_name='br-int',has_traffic_filtering=True,id=19a226f1-aa84-4dea-bd99-c1e740d75d57,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a226f1-aa') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG os_vif [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:9b:6a,bridge_name='br-int',has_traffic_filtering=True,id=19a226f1-aa84-4dea-bd99-c1e740d75d57,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a226f1-aa') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19a226f1-aa, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0246887e-b556-4036-9b7e-e26ba287fafe) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:38:13 user nova-compute[75100]: INFO os_vif [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:9b:6a,bridge_name='br-int',has_traffic_filtering=True,id=19a226f1-aa84-4dea-bd99-c1e740d75d57,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19a226f1-aa')
Nov 13 17:38:13 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Deleting instance files /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94_del
Nov 13 17:38:13 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Deletion of /opt/stack/data/nova/instances/59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94_del complete
Nov 13 17:38:13 user nova-compute[75100]: INFO nova.compute.manager [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 17:38:13 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:38:13 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:38:14 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:38:14 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Took 0.62 seconds to deallocate network for instance.
Nov 13 17:38:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-d49f0704-9e8b-4f6c-af70-a14ca09c9e3e req-e8dd1dc2-ca57-449e-a791-a6328fe0a86c service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Received event network-vif-deleted-19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:38:14 user nova-compute[75100]: INFO nova.compute.manager [req-d49f0704-9e8b-4f6c-af70-a14ca09c9e3e req-e8dd1dc2-ca57-449e-a791-a6328fe0a86c service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Neutron deleted interface 19a226f1-aa84-4dea-bd99-c1e740d75d57; detaching it from the instance and deleting it from the info cache
Nov 13 17:38:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-d49f0704-9e8b-4f6c-af70-a14ca09c9e3e req-e8dd1dc2-ca57-449e-a791-a6328fe0a86c service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:38:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-d49f0704-9e8b-4f6c-af70-a14ca09c9e3e req-e8dd1dc2-ca57-449e-a791-a6328fe0a86c service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Detach interface failed, port_id=19a226f1-aa84-4dea-bd99-c1e740d75d57, reason: Instance 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:38:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:14 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:38:14 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:38:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:14 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Deleted allocations for instance 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94
Nov 13 17:38:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-dc18246b-0337-44e1-a83a-112b6fb976ea tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.106s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-3e9acfb5-5815-4126-8f4d-7aa0f4638388 req-a766fd18-2d79-4276-a5b5-1f85041f8073 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Received event network-vif-plugged-19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:38:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3e9acfb5-5815-4126-8f4d-7aa0f4638388 req-a766fd18-2d79-4276-a5b5-1f85041f8073 service nova] Acquiring lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3e9acfb5-5815-4126-8f4d-7aa0f4638388 req-a766fd18-2d79-4276-a5b5-1f85041f8073 service nova] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3e9acfb5-5815-4126-8f4d-7aa0f4638388 req-a766fd18-2d79-4276-a5b5-1f85041f8073 service nova] Lock "59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-3e9acfb5-5815-4126-8f4d-7aa0f4638388 req-a766fd18-2d79-4276-a5b5-1f85041f8073 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] No waiting events found dispatching network-vif-plugged-19a226f1-aa84-4dea-bd99-c1e740d75d57 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:38:15 user nova-compute[75100]: WARNING nova.compute.manager [req-3e9acfb5-5815-4126-8f4d-7aa0f4638388 req-a766fd18-2d79-4276-a5b5-1f85041f8073 service nova] [instance: 59f3cbf4-ada9-4cc1-8eda-5d0c44e91a94] Received unexpected event network-vif-plugged-19a226f1-aa84-4dea-bd99-c1e740d75d57 for instance with vm_state deleted and task_state None.
Nov 13 17:38:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:18 user nova-compute[75100]: INFO nova.compute.manager [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Terminating instance
Nov 13 17:38:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-632d63d1-3967-41ca-861d-3f86a3063e52 req-80ffad9d-631f-44f7-9eb3-030808829be6 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Received event network-vif-unplugged-15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-632d63d1-3967-41ca-861d-3f86a3063e52 req-80ffad9d-631f-44f7-9eb3-030808829be6 service nova] Acquiring lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-632d63d1-3967-41ca-861d-3f86a3063e52 req-80ffad9d-631f-44f7-9eb3-030808829be6 service nova] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-632d63d1-3967-41ca-861d-3f86a3063e52 req-80ffad9d-631f-44f7-9eb3-030808829be6 service nova] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-632d63d1-3967-41ca-861d-3f86a3063e52 req-80ffad9d-631f-44f7-9eb3-030808829be6 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] No waiting events found dispatching network-vif-unplugged-15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-632d63d1-3967-41ca-861d-3f86a3063e52 req-80ffad9d-631f-44f7-9eb3-030808829be6 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Received event network-vif-unplugged-15335f7b-d811-486f-a5ce-3643fa79fbc7 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Instance destroyed successfully.
Nov 13 17:38:19 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lazy-loading 'resources' on Instance uuid b0c1af59-f1bd-4c02-8843-e477cd7169d8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1834635745',display_name='tempest-ServerActionsTestOtherA-server-1834635745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1834635745',id=5,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArXX8H/F/4k/bCD26MQyJfYc6kVyijAa21ATX3s9SJ4y/SgOLDqvjWXABytQ7Y0rezN8922Yqg0PmzPzy90j9+erJSCwuQJnigd+guQkVWmuyFrLUQ16eK1oB+ijXr+Rw==',key_name='tempest-keypair-216019137',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:19:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='119dde6420324f52a165a5610c77d1c3',ramdisk_id='',reservation_id='r-i2xj0rnj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-226710821',owner_user_name='tempest-ServerActionsTestOtherA-226710821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:19:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ea28cc48696459f96e7ad8dacad33da',uuid=b0c1af59-f1bd-4c02-8843-e477cd7169d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converting VIF {"id": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "address": "fa:16:3e:1c:8a:63", "network": {"id": "9d1af3b3-49da-436e-8972-9b95afabc64f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507746899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119dde6420324f52a165a5610c77d1c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15335f7b-d8", "ovs_interfaceid": "15335f7b-d811-486f-a5ce-3643fa79fbc7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:8a:63,bridge_name='br-int',has_traffic_filtering=True,id=15335f7b-d811-486f-a5ce-3643fa79fbc7,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15335f7b-d8') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG os_vif [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:8a:63,bridge_name='br-int',has_traffic_filtering=True,id=15335f7b-d811-486f-a5ce-3643fa79fbc7,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15335f7b-d8') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15335f7b-d8, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bfaa87c-7e75-4ee6-bd29-ce1f0250cc92) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:38:19 user nova-compute[75100]: INFO os_vif [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:8a:63,bridge_name='br-int',has_traffic_filtering=True,id=15335f7b-d811-486f-a5ce-3643fa79fbc7,network=Network(9d1af3b3-49da-436e-8972-9b95afabc64f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15335f7b-d8')
Nov 13 17:38:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Deleting instance files /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8_del
Nov 13 17:38:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Deletion of /opt/stack/data/nova/instances/b0c1af59-f1bd-4c02-8843-e477cd7169d8_del complete
Nov 13 17:38:19 user nova-compute[75100]: INFO nova.compute.manager [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 13 17:38:19 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:38:19 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Took 0.57 seconds to deallocate network for instance.
Nov 13 17:38:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:20 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:38:20 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:38:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:20 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Deleted allocations for instance b0c1af59-f1bd-4c02-8843-e477cd7169d8
Nov 13 17:38:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0edf5935-ad5c-4f2f-a13c-c0a3193d60b1 tempest-ServerActionsTestOtherA-226710821 tempest-ServerActionsTestOtherA-226710821-project-member] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.016s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-6f0b886d-d6ec-4929-9f25-5912dc5cab6c req-254c34ef-9f71-48e8-ad7d-53c9bd4700d2 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Received event network-vif-plugged-15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:38:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6f0b886d-d6ec-4929-9f25-5912dc5cab6c req-254c34ef-9f71-48e8-ad7d-53c9bd4700d2 service nova] Acquiring lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6f0b886d-d6ec-4929-9f25-5912dc5cab6c req-254c34ef-9f71-48e8-ad7d-53c9bd4700d2 service nova] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6f0b886d-d6ec-4929-9f25-5912dc5cab6c req-254c34ef-9f71-48e8-ad7d-53c9bd4700d2 service nova] Lock "b0c1af59-f1bd-4c02-8843-e477cd7169d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-6f0b886d-d6ec-4929-9f25-5912dc5cab6c req-254c34ef-9f71-48e8-ad7d-53c9bd4700d2 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] No waiting events found dispatching network-vif-plugged-15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:38:20 user nova-compute[75100]: WARNING nova.compute.manager [req-6f0b886d-d6ec-4929-9f25-5912dc5cab6c req-254c34ef-9f71-48e8-ad7d-53c9bd4700d2 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Received unexpected event network-vif-plugged-15335f7b-d811-486f-a5ce-3643fa79fbc7 for instance with vm_state deleted and task_state None.
Nov 13 17:38:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-6f0b886d-d6ec-4929-9f25-5912dc5cab6c req-254c34ef-9f71-48e8-ad7d-53c9bd4700d2 service nova] [instance: b0c1af59-f1bd-4c02-8843-e477cd7169d8] Received event network-vif-deleted-15335f7b-d811-486f-a5ce-3643fa79fbc7 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:38:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:38:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:38:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:38:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:38:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:31 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:38:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:38:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:38:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:38:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:36 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:38:36 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:38:36 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8332MB free_disk=25.09500503540039GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 83d28254-9d5f-4190-85de-76f5a2b69dac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 81c970a1-23fd-4cda-a532-a40811e85e11 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f0bf103e-23eb-486a-a5df-9f3e66d4d076 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:38:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:38:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:38:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 17:38:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:38:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:38:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:38:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:47 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:38:47 user nova-compute[75100]: INFO nova.compute.claims [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Claim successful on node user
Nov 13 17:38:47 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:38:47 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:38:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:38:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG nova.policy [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc9396967a5f4666b8d1d4df794b31aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb8e861865462e80ed3a213a09f8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:38:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Creating image(s)
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "/opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "/opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "/opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk 1073741824" returned: 0 in 0.061s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:38:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:38:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:38:49 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Cannot resize image /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:38:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:38:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Ensure instance console log exists: /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:38:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:49 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Successfully created port: dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:38:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Successfully updated port: dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquired lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-a736899d-662b-46f5-99cd-aa345d5a1683 req-60b19d93-5252-4332-acf1-4f4551429a1b service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received event network-changed-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-a736899d-662b-46f5-99cd-aa345d5a1683 req-60b19d93-5252-4332-acf1-4f4551429a1b service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Refreshing instance network info cache due to event network-changed-dec33d9c-57c8-41a4-a519-c1b6712c80f6. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a736899d-662b-46f5-99cd-aa345d5a1683 req-60b19d93-5252-4332-acf1-4f4551429a1b service nova] Acquiring lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Updating instance_info_cache with network_info: [{"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Releasing lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Instance network_info: |[{"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a736899d-662b-46f5-99cd-aa345d5a1683 req-60b19d93-5252-4332-acf1-4f4551429a1b service nova] Acquired lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.network.neutron [req-a736899d-662b-46f5-99cd-aa345d5a1683 req-60b19d93-5252-4332-acf1-4f4551429a1b service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Refreshing network info cache for port dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Start _get_guest_xml network_info=[{"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:38:50 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:38:50 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1889027385',display_name='tempest-TestStampPattern-server-1889027385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1889027385',id=39,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrOJF+I3W+VJrAHWGtN2MBJOMvEMODLQzn5ApWc/HW7iPWY+6/PHmwlDqsSJlNM55EzzJ9KtnrIwnuukCA4w5GI3FhgGrJxENswyXMhu8EweYbo1/3V9R/qP3i6bwmSqA==',key_name='tempest-TestStampPattern-1218817336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beeb8e861865462e80ed3a213a09f8b1',ramdisk_id='',reservation_id='r-okayg1of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-317206420',owner_user_name='tempest-TestStampPattern-317206420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:38:48Z,user_data=None,user_id='bc9396967a5f4666b8d1d4df794b31aa',uuid=f589271c-7e6c-4352-8b85-8a7aca61dc7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Converting VIF {"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:46:73,bridge_name='br-int',has_traffic_filtering=True,id=dec33d9c-57c8-41a4-a519-c1b6712c80f6,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec33d9c-57') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lazy-loading 'pci_devices' on Instance uuid f589271c-7e6c-4352-8b85-8a7aca61dc7f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:38:50 user nova-compute[75100]:   <uuid>f589271c-7e6c-4352-8b85-8a7aca61dc7f</uuid>
Nov 13 17:38:50 user nova-compute[75100]:   <name>instance-00000027</name>
Nov 13 17:38:50 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:38:50 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:38:50 user nova-compute[75100]:   <metadata>
Nov 13 17:38:50 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:38:50 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:38:50 user nova-compute[75100]:       <nova:name>tempest-TestStampPattern-server-1889027385</nova:name>
Nov 13 17:38:50 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:38:50</nova:creationTime>
Nov 13 17:38:50 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:38:50 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:38:50 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:38:50 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:38:50 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:38:50 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:38:50 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:38:50 user nova-compute[75100]:       <nova:owner>
Nov 13 17:38:50 user nova-compute[75100]:         <nova:user uuid="bc9396967a5f4666b8d1d4df794b31aa">tempest-TestStampPattern-317206420-project-member</nova:user>
Nov 13 17:38:50 user nova-compute[75100]:         <nova:project uuid="beeb8e861865462e80ed3a213a09f8b1">tempest-TestStampPattern-317206420</nova:project>
Nov 13 17:38:50 user nova-compute[75100]:       </nova:owner>
Nov 13 17:38:50 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:38:50 user nova-compute[75100]:       <nova:ports>
Nov 13 17:38:50 user nova-compute[75100]:         <nova:port uuid="dec33d9c-57c8-41a4-a519-c1b6712c80f6">
Nov 13 17:38:50 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 17:38:50 user nova-compute[75100]:         </nova:port>
Nov 13 17:38:50 user nova-compute[75100]:       </nova:ports>
Nov 13 17:38:50 user nova-compute[75100]:     </nova:instance>
Nov 13 17:38:50 user nova-compute[75100]:   </metadata>
Nov 13 17:38:50 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:38:50 user nova-compute[75100]:     <system>
Nov 13 17:38:50 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:38:50 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:38:50 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:38:50 user nova-compute[75100]:       <entry name="serial">f589271c-7e6c-4352-8b85-8a7aca61dc7f</entry>
Nov 13 17:38:50 user nova-compute[75100]:       <entry name="uuid">f589271c-7e6c-4352-8b85-8a7aca61dc7f</entry>
Nov 13 17:38:50 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:38:50 user nova-compute[75100]:     </system>
Nov 13 17:38:50 user nova-compute[75100]:   </sysinfo>
Nov 13 17:38:50 user nova-compute[75100]:   <os>
Nov 13 17:38:50 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:38:50 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:38:50 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:38:50 user nova-compute[75100]:   </os>
Nov 13 17:38:50 user nova-compute[75100]:   <features>
Nov 13 17:38:50 user nova-compute[75100]:     <acpi/>
Nov 13 17:38:50 user nova-compute[75100]:     <apic/>
Nov 13 17:38:50 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:38:50 user nova-compute[75100]:   </features>
Nov 13 17:38:50 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:38:50 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:38:50 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:38:50 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:38:50 user nova-compute[75100]:   </clock>
Nov 13 17:38:50 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:38:50 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:38:50 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:38:50 user nova-compute[75100]:   </cpu>
Nov 13 17:38:50 user nova-compute[75100]:   <devices>
Nov 13 17:38:50 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:38:50 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:38:50 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk"/>
Nov 13 17:38:50 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:38:50 user nova-compute[75100]:     </disk>
Nov 13 17:38:50 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:38:50 user nova-compute[75100]:       <mac address="fa:16:3e:e1:46:73"/>
Nov 13 17:38:50 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:38:50 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:38:50 user nova-compute[75100]:       <target dev="tapdec33d9c-57"/>
Nov 13 17:38:50 user nova-compute[75100]:     </interface>
Nov 13 17:38:50 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:38:50 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/console.log" append="off"/>
Nov 13 17:38:50 user nova-compute[75100]:     </serial>
Nov 13 17:38:50 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:38:50 user nova-compute[75100]:     <video>
Nov 13 17:38:50 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:38:50 user nova-compute[75100]:     </video>
Nov 13 17:38:50 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:38:50 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:38:50 user nova-compute[75100]:     </rng>
Nov 13 17:38:50 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:38:50 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:38:50 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:38:50 user nova-compute[75100]:     </memballoon>
Nov 13 17:38:50 user nova-compute[75100]:   </devices>
Nov 13 17:38:50 user nova-compute[75100]: </domain>
Nov 13 17:38:50 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1889027385',display_name='tempest-TestStampPattern-server-1889027385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1889027385',id=39,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrOJF+I3W+VJrAHWGtN2MBJOMvEMODLQzn5ApWc/HW7iPWY+6/PHmwlDqsSJlNM55EzzJ9KtnrIwnuukCA4w5GI3FhgGrJxENswyXMhu8EweYbo1/3V9R/qP3i6bwmSqA==',key_name='tempest-TestStampPattern-1218817336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beeb8e861865462e80ed3a213a09f8b1',ramdisk_id='',reservation_id='r-okayg1of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-317206420',owner_user_name='tempest-TestStampPattern-317206420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:38:48Z,user_data=None,user_id='bc9396967a5f4666b8d1d4df794b31aa',uuid=f589271c-7e6c-4352-8b85-8a7aca61dc7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Converting VIF {"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:46:73,bridge_name='br-int',has_traffic_filtering=True,id=dec33d9c-57c8-41a4-a519-c1b6712c80f6,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec33d9c-57') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG os_vif [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:46:73,bridge_name='br-int',has_traffic_filtering=True,id=dec33d9c-57c8-41a4-a519-c1b6712c80f6,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec33d9c-57') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b9230bc-d358-5802-bcad-cfd448d5222b', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdec33d9c-57, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdec33d9c-57, col_values=(('qos', UUID('d9e754d0-3900-4799-a07e-ff938d5dedbf')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdec33d9c-57, col_values=(('external_ids', {'iface-id': 'dec33d9c-57c8-41a4-a519-c1b6712c80f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:46:73', 'vm-uuid': 'f589271c-7e6c-4352-8b85-8a7aca61dc7f'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:50 user nova-compute[75100]: INFO os_vif [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:46:73,bridge_name='br-int',has_traffic_filtering=True,id=dec33d9c-57c8-41a4-a519-c1b6712c80f6,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec33d9c-57')
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:38:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] No VIF found with MAC fa:16:3e:e1:46:73, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:38:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-a736899d-662b-46f5-99cd-aa345d5a1683 req-60b19d93-5252-4332-acf1-4f4551429a1b service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Updated VIF entry in instance network info cache for port dec33d9c-57c8-41a4-a519-c1b6712c80f6. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:38:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-a736899d-662b-46f5-99cd-aa345d5a1683 req-60b19d93-5252-4332-acf1-4f4551429a1b service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Updating instance_info_cache with network_info: [{"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:38:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a736899d-662b-46f5-99cd-aa345d5a1683 req-60b19d93-5252-4332-acf1-4f4551429a1b service nova] Releasing lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:38:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-c6ff6f21-9dfc-48fd-9b63-48bdca314c68 req-37b3d52b-df72-4271-8144-fc42bdd9c4b1 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received event network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:38:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c6ff6f21-9dfc-48fd-9b63-48bdca314c68 req-37b3d52b-df72-4271-8144-fc42bdd9c4b1 service nova] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c6ff6f21-9dfc-48fd-9b63-48bdca314c68 req-37b3d52b-df72-4271-8144-fc42bdd9c4b1 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c6ff6f21-9dfc-48fd-9b63-48bdca314c68 req-37b3d52b-df72-4271-8144-fc42bdd9c4b1 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-c6ff6f21-9dfc-48fd-9b63-48bdca314c68 req-37b3d52b-df72-4271-8144-fc42bdd9c4b1 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] No waiting events found dispatching network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:38:52 user nova-compute[75100]: WARNING nova.compute.manager [req-c6ff6f21-9dfc-48fd-9b63-48bdca314c68 req-37b3d52b-df72-4271-8144-fc42bdd9c4b1 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received unexpected event network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 for instance with vm_state building and task_state spawning.
Nov 13 17:38:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:38:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:38:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Instance spawned successfully.
Nov 13 17:38:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:38:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-39c7dc4d-3d9d-489b-8597-539a7e08b993 req-1f7d053f-fb4f-4ebe-90f5-12e964a3e7e4 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received event network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:38:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-39c7dc4d-3d9d-489b-8597-539a7e08b993 req-1f7d053f-fb4f-4ebe-90f5-12e964a3e7e4 service nova] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:38:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-39c7dc4d-3d9d-489b-8597-539a7e08b993 req-1f7d053f-fb4f-4ebe-90f5-12e964a3e7e4 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:38:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-39c7dc4d-3d9d-489b-8597-539a7e08b993 req-1f7d053f-fb4f-4ebe-90f5-12e964a3e7e4 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-39c7dc4d-3d9d-489b-8597-539a7e08b993 req-1f7d053f-fb4f-4ebe-90f5-12e964a3e7e4 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] No waiting events found dispatching network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:38:54 user nova-compute[75100]: WARNING nova.compute.manager [req-39c7dc4d-3d9d-489b-8597-539a7e08b993 req-1f7d053f-fb4f-4ebe-90f5-12e964a3e7e4 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received unexpected event network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 for instance with vm_state building and task_state spawning.
Nov 13 17:38:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:38:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:38:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:38:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:38:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:38:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:38:54 user nova-compute[75100]: INFO nova.compute.manager [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 13 17:38:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:38:54 user nova-compute[75100]: INFO nova.compute.manager [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Took 6.94 seconds to build instance.
Nov 13 17:38:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f639f483-f389-428c-bd00-a1a428162f63 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.060s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:38:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:38:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG nova.objects.instance [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'flavor' on Instance uuid 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:01 user nova-compute[75100]: INFO nova.compute.manager [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Attaching volume ee2be01c-6462-4d98-b582-f21609370f4f to /dev/vdb
Nov 13 17:39:01 user nova-compute[75100]: DEBUG os_brick.utils [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a47abc1-41ff-4ff6-b3cb-4ff6deaff0f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded28220-d6e3-4231-aa9e-f36a4120811d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4453cb-52a7-45de-a77a-8b9c975fb3a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[471e8ae0-c672-4241-a2b5-0a04d9dc1ad8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:39:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:39:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:39:02 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:39:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd6ecc5-882d-426d-9205-3713579152a2]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:39:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:39:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:39:02 user nova-compute[75100]: DEBUG os_brick.utils [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:39:02 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updating existing volume attachment record: 27dd52c5-35c4-48df-bd21-2ffefae0503b {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:03 user nova-compute[75100]: INFO nova.compute.manager [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Terminating instance
Nov 13 17:39:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-e819a4d2-3194-49c8-bf56-8c54dc258b7b req-76a560d5-b98b-4203-8460-82ba10ecd452 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-unplugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e819a4d2-3194-49c8-bf56-8c54dc258b7b req-76a560d5-b98b-4203-8460-82ba10ecd452 service nova] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e819a4d2-3194-49c8-bf56-8c54dc258b7b req-76a560d5-b98b-4203-8460-82ba10ecd452 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e819a4d2-3194-49c8-bf56-8c54dc258b7b req-76a560d5-b98b-4203-8460-82ba10ecd452 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-e819a4d2-3194-49c8-bf56-8c54dc258b7b req-76a560d5-b98b-4203-8460-82ba10ecd452 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] No waiting events found dispatching network-vif-unplugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-e819a4d2-3194-49c8-bf56-8c54dc258b7b req-76a560d5-b98b-4203-8460-82ba10ecd452 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-unplugged-d15270b0-a020-4fc1-bac3-3ea3da038478 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:39:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Instance destroyed successfully.
Nov 13 17:39:04 user nova-compute[75100]: DEBUG nova.objects.instance [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'resources' on Instance uuid 83d28254-9d5f-4190-85de-76f5a2b69dac {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:22:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2044782487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2044782487',id=13,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-pohevv18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:26:14Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=83d28254-9d5f-4190-85de-76f5a2b69dac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "d15270b0-a020-4fc1-bac3-3ea3da038478", "address": "fa:16:3e:d0:d9:37", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd15270b0-a0", "ovs_interfaceid": "d15270b0-a020-4fc1-bac3-3ea3da038478", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=d15270b0-a020-4fc1-bac3-3ea3da038478,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15270b0-a0') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_vif [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=d15270b0-a020-4fc1-bac3-3ea3da038478,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15270b0-a0') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd15270b0-a0, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae57f27a-b7d5-4d17-b5a4-41be8c4bf7b8) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:04 user nova-compute[75100]: INFO os_vif [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:d9:37,bridge_name='br-int',has_traffic_filtering=True,id=d15270b0-a020-4fc1-bac3-3ea3da038478,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd15270b0-a0')
Nov 13 17:39:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxgqfret', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:39:04 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8db8db2-d667-493d-aee3-8dd244f0098f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:39:04 user nova-compute[75100]: No targets found.
Nov 13 17:39:04 user nova-compute[75100]: iSNS:
Nov 13 17:39:04 user nova-compute[75100]: No targets found.
Nov 13 17:39:04 user nova-compute[75100]: STATIC:
Nov 13 17:39:04 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9
Nov 13 17:39:04 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:39:04 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:39:04 user nova-compute[75100]: FIRMWARE:
Nov 13 17:39:04 user nova-compute[75100]: No targets found.
Nov 13 17:39:04 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:39:04 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:39:04 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[938ad2c9-0cd6-4cb9-ad13-eb84a013644f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f472d4c9-1b55-49cd-88da-d2664d3a4b2c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:39:04 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 (non-flash)
Nov 13 17:39:04 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38c3eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[df93ae76-ad27-4942-bd5a-933a79eb784e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9c2a37-406d-4fbb-828e-a62078dc09be]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fb840b-52b1-4cbf-9d11-476ca12dd9ef]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b14dd47-988f-4927-a92a-7cb1631d9182]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[781cabc6-e234-4c71-abe1-defe16321e8b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a670ee5-144a-4f62-8690-6d18ec02eade]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9, portal: 172.16.0.220,3260]
Nov 13 17:39:04 user nova-compute[75100]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9, portal: 172.16.0.220,3260] successful.
Nov 13 17:39:04 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4b547be-9d01-4fe4-86fc-b62242a82ab9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca50dc92-d8ab-4c31-a400-fcb401a788b8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] <== disconnect_volume: return (328ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:39:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Deleting instance files /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac_del
Nov 13 17:39:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Deletion of /opt/stack/data/nova/instances/83d28254-9d5f-4190-85de-76f5a2b69dac_del complete
Nov 13 17:39:04 user nova-compute[75100]: INFO nova.compute.manager [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 13 17:39:04 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:39:04 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:39:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:05 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-3a4601fb-7bcf-4c76-ae1b-373f46c69fb5 req-95103108-e825-4706-98d8-5febe6bc3cd8 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-deleted-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:05 user nova-compute[75100]: INFO nova.compute.manager [req-3a4601fb-7bcf-4c76-ae1b-373f46c69fb5 req-95103108-e825-4706-98d8-5febe6bc3cd8 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Neutron deleted interface d15270b0-a020-4fc1-bac3-3ea3da038478; detaching it from the instance and deleting it from the info cache
Nov 13 17:39:05 user nova-compute[75100]: DEBUG nova.network.neutron [req-3a4601fb-7bcf-4c76-ae1b-373f46c69fb5 req-95103108-e825-4706-98d8-5febe6bc3cd8 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:05 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Took 0.66 seconds to deallocate network for instance.
Nov 13 17:39:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-3a4601fb-7bcf-4c76-ae1b-373f46c69fb5 req-95103108-e825-4706-98d8-5febe6bc3cd8 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Detach interface failed, port_id=d15270b0-a020-4fc1-bac3-3ea3da038478, reason: Instance 83d28254-9d5f-4190-85de-76f5a2b69dac could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-3ecc42ab-fd4b-4741-aa22-e8b535068db6 req-76dad6e7-7b02-4b5e-9151-baeab8e47b64 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3ecc42ab-fd4b-4741-aa22-e8b535068db6 req-76dad6e7-7b02-4b5e-9151-baeab8e47b64 service nova] Acquiring lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3ecc42ab-fd4b-4741-aa22-e8b535068db6 req-76dad6e7-7b02-4b5e-9151-baeab8e47b64 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3ecc42ab-fd4b-4741-aa22-e8b535068db6 req-76dad6e7-7b02-4b5e-9151-baeab8e47b64 service nova] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-3ecc42ab-fd4b-4741-aa22-e8b535068db6 req-76dad6e7-7b02-4b5e-9151-baeab8e47b64 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] No waiting events found dispatching network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:06 user nova-compute[75100]: WARNING nova.compute.manager [req-3ecc42ab-fd4b-4741-aa22-e8b535068db6 req-76dad6e7-7b02-4b5e-9151-baeab8e47b64 service nova] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Received unexpected event network-vif-plugged-d15270b0-a020-4fc1-bac3-3ea3da038478 for instance with vm_state active and task_state deleting.
Nov 13 17:39:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MASpkilB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:39:06 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:39:06 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:39:06 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bd2afa-61df-4158-9299-606da0ea81cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:39:06 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d4a88f-6429-4e2b-a05f-fe37a9683097]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f] added
Nov 13 17:39:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[df005511-8722-4632-bb24-c61958504c59]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2777fb-0971-4a7e-9ef0-ac538268bd49]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:06 user nova-compute[75100]: INFO nova.compute.manager [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: 83d28254-9d5f-4190-85de-76f5a2b69dac] Took 0.87 seconds to detach 1 volumes for instance.
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MASpkilB {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MASpkilB" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac7cc85-7ed8-4e82-9981-f2e13de6dd98]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MASpkilB'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[103dfa42-7591-43f1-8b09-eecef812fc76]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e97cbd-ae12-4759-b5ec-ec081b09bddc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:39:06 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:39:06 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:39:06 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 17:39:06 user nova-compute[75100]: 
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7145c3c2-9c8d-4643-8e64-7c3503ac3ba0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f, portal: 172.16.0.220,3260]
Nov 13 17:39:06 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f, portal: 172.16.0.220,3260] successful.
Nov 13 17:39:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f9b9ff-9e36-4dec-a2da-d012ea58bec0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[18505fbe-efb3-405f-8659-59f2facbd215]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:39:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:39:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf156b2-baa7-4409-90fc-0939839bb508]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MASpkilB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:06 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Deleted allocations for instance 83d28254-9d5f-4190-85de-76f5a2b69dac
Nov 13 17:39:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-554b3ed9-b3d1-426b-9844-23e7dafef47c tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "83d28254-9d5f-4190-85de-76f5a2b69dac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.272s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:39:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23338376264633162', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:39:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338376264633162', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:39:07 user nova-compute[75100]: DEBUG nova.objects.instance [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'flavor' on Instance uuid 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:39:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:39:07 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:39:07 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:39:07 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:39:07 user nova-compute[75100]:   <serial>ee2be01c-6462-4d98-b582-f21609370f4f</serial>
Nov 13 17:39:07 user nova-compute[75100]: </disk>
Nov 13 17:39:07 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:39:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:39:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:39:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] No VIF found with MAC fa:16:3e:84:df:da, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:39:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24ef8f88-8a7f-4ae3-8c11-7cfd919ee2f2 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.313s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-7c9a582f-5019-451b-a985-7d2dddd127ad req-1674d7b7-7a2d-4011-9e16-4db96a57416e service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Received event network-changed-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-7c9a582f-5019-451b-a985-7d2dddd127ad req-1674d7b7-7a2d-4011-9e16-4db96a57416e service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Refreshing instance network info cache due to event network-changed-18412885-d3aa-422d-a8f7-eb1c96b1f0c8. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:39:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7c9a582f-5019-451b-a985-7d2dddd127ad req-1674d7b7-7a2d-4011-9e16-4db96a57416e service nova] Acquiring lock "refresh_cache-81c970a1-23fd-4cda-a532-a40811e85e11" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:39:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7c9a582f-5019-451b-a985-7d2dddd127ad req-1674d7b7-7a2d-4011-9e16-4db96a57416e service nova] Acquired lock "refresh_cache-81c970a1-23fd-4cda-a532-a40811e85e11" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:39:09 user nova-compute[75100]: DEBUG nova.network.neutron [req-7c9a582f-5019-451b-a985-7d2dddd127ad req-1674d7b7-7a2d-4011-9e16-4db96a57416e service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Refreshing network info cache for port 18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:39:10 user nova-compute[75100]: DEBUG nova.network.neutron [req-7c9a582f-5019-451b-a985-7d2dddd127ad req-1674d7b7-7a2d-4011-9e16-4db96a57416e service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Updated VIF entry in instance network info cache for port 18412885-d3aa-422d-a8f7-eb1c96b1f0c8. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:39:10 user nova-compute[75100]: DEBUG nova.network.neutron [req-7c9a582f-5019-451b-a985-7d2dddd127ad req-1674d7b7-7a2d-4011-9e16-4db96a57416e service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Updating instance_info_cache with network_info: [{"id": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "address": "fa:16:3e:74:57:cb", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18412885-d3", "ovs_interfaceid": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7c9a582f-5019-451b-a985-7d2dddd127ad req-1674d7b7-7a2d-4011-9e16-4db96a57416e service nova] Releasing lock "refresh_cache-81c970a1-23fd-4cda-a532-a40811e85e11" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:39:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-ad127f34-393b-4776-bec8-1d0e88716a94 req-c362f6d5-7cd1-4947-9221-ae8065579909 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-changed-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-ad127f34-393b-4776-bec8-1d0e88716a94 req-c362f6d5-7cd1-4947-9221-ae8065579909 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Refreshing instance network info cache due to event network-changed-bde2a813-7715-4fc1-a99e-f3cc8484988b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:39:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ad127f34-393b-4776-bec8-1d0e88716a94 req-c362f6d5-7cd1-4947-9221-ae8065579909 service nova] Acquiring lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:39:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ad127f34-393b-4776-bec8-1d0e88716a94 req-c362f6d5-7cd1-4947-9221-ae8065579909 service nova] Acquired lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:39:10 user nova-compute[75100]: DEBUG nova.network.neutron [req-ad127f34-393b-4776-bec8-1d0e88716a94 req-c362f6d5-7cd1-4947-9221-ae8065579909 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Refreshing network info cache for port bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "81c970a1-23fd-4cda-a532-a40811e85e11" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "81c970a1-23fd-4cda-a532-a40811e85e11" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG nova.objects.instance [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'flavor' on Instance uuid 81c970a1-23fd-4cda-a532-a40811e85e11 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG nova.network.neutron [req-ad127f34-393b-4776-bec8-1d0e88716a94 req-c362f6d5-7cd1-4947-9221-ae8065579909 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updated VIF entry in instance network info cache for port bde2a813-7715-4fc1-a99e-f3cc8484988b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG nova.network.neutron [req-ad127f34-393b-4776-bec8-1d0e88716a94 req-c362f6d5-7cd1-4947-9221-ae8065579909 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updating instance_info_cache with network_info: [{"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ad127f34-393b-4776-bec8-1d0e88716a94 req-c362f6d5-7cd1-4947-9221-ae8065579909 service nova] Releasing lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "81c970a1-23fd-4cda-a532-a40811e85e11" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.144s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "81c970a1-23fd-4cda-a532-a40811e85e11" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "81c970a1-23fd-4cda-a532-a40811e85e11" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:11 user nova-compute[75100]: INFO nova.compute.manager [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Attaching volume 8f440fa3-bcca-432e-b587-8654e24fccf5 to /dev/vdb
Nov 13 17:39:11 user nova-compute[75100]: DEBUG os_brick.utils [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[31959989-2149-4671-8340-9762a01e83c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3d2ceb-fbb3-419b-a754-ec67a70f71ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5100b8a5-4516-48fb-80ce-81c7f1964d2f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0235cf-23b8-450c-8bfc-2fde428e73a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:39:11 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:39:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[96079746-eff3-443b-b540-957ba5046ec9]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG os_brick.utils [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:39:11 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Updating existing volume attachment record: 6dc8843d-3039-47db-a8d2-a085b7a14b30 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:39:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-af0936a8-1922-49af-bb28-2e6eebf04941 req-33fe0285-74b8-4557-b7c7-a4dfd85861a6 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-changed-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-af0936a8-1922-49af-bb28-2e6eebf04941 req-33fe0285-74b8-4557-b7c7-a4dfd85861a6 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Refreshing instance network info cache due to event network-changed-bde2a813-7715-4fc1-a99e-f3cc8484988b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:39:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af0936a8-1922-49af-bb28-2e6eebf04941 req-33fe0285-74b8-4557-b7c7-a4dfd85861a6 service nova] Acquiring lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:39:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af0936a8-1922-49af-bb28-2e6eebf04941 req-33fe0285-74b8-4557-b7c7-a4dfd85861a6 service nova] Acquired lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:39:13 user nova-compute[75100]: DEBUG nova.network.neutron [req-af0936a8-1922-49af-bb28-2e6eebf04941 req-33fe0285-74b8-4557-b7c7-a4dfd85861a6 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Refreshing network info cache for port bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:39:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-af0936a8-1922-49af-bb28-2e6eebf04941 req-33fe0285-74b8-4557-b7c7-a4dfd85861a6 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updated VIF entry in instance network info cache for port bde2a813-7715-4fc1-a99e-f3cc8484988b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:39:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-af0936a8-1922-49af-bb28-2e6eebf04941 req-33fe0285-74b8-4557-b7c7-a4dfd85861a6 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updating instance_info_cache with network_info: [{"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af0936a8-1922-49af-bb28-2e6eebf04941 req-33fe0285-74b8-4557-b7c7-a4dfd85861a6 service nova] Releasing lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:39:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:14 user nova-compute[75100]: INFO nova.compute.manager [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Rebooting instance
Nov 13 17:39:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:39:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquired lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:39:14 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:39:15 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updating instance_info_cache with network_info: [{"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Releasing lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:39:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:39:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "009a667b-e7aa-480e-8b81-76001a1434f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "009a667b-e7aa-480e-8b81-76001a1434f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:39:16 user nova-compute[75100]: INFO nova.compute.claims [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Claim successful on node user
Nov 13 17:39:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUhMLPYe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:39:16 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:39:16 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:39:16 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[680c80fe-7013-4c73-b2bc-4485647f8ed4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:39:16 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[476b4bc7-5d42-457f-a8f4-0dcf82bd899a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5] added
Nov 13 17:39:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f5f3ed-b9c4-47e7-a702-d29eb989e907]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[44266dfa-409c-4581-b6f0-a36398b1a5e1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xUhMLPYe {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xUhMLPYe" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5638998b-19f5-4883-98be-da0a25d5116a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xUhMLPYe'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a657e9d-9e11-47b9-b5bf-1fff55f85622]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f993e2d8-d629-4388-82fe-aebc966a286f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:39:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:39:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd125079-1c2b-4cc9-aa09-744c429b10e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5, portal: 172.16.0.220,3260]
Nov 13 17:39:16 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5, portal: 172.16.0.220,3260] successful.
Nov 13 17:39:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[36252e31-5bc5-4b9d-93fe-cc2f10aa7b28]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6456f4e4-8bc0-4f89-a2c9-a3ca6e4d46eb]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:39:16 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)
Nov 13 17:39:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:39:16 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)
Nov 13 17:39:16 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a44f44-f6d2-4822-b10c-95df5ca83ab7]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUhMLPYe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:39:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:39:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG nova.policy [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '380d78e868b44598aa311630ce34e0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '047cedafb8344129a644233034fef4f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:39:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Creating image(s)
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "/opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "/opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "/opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:16 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk 1073741824" returned: 0 in 0.058s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Successfully created port: a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23864303439393061', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864303439393061', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Cannot resize image /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Ensure instance console log exists: /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG nova.objects.instance [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'flavor' on Instance uuid 81c970a1-23fd-4cda-a532-a40811e85e11 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:39:17 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:39:17 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 13 17:39:17 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:39:17 user nova-compute[75100]:   <serial>8f440fa3-bcca-432e-b587-8654e24fccf5</serial>
Nov 13 17:39:17 user nova-compute[75100]: </disk>
Nov 13 17:39:17 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:39:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No VIF found with MAC fa:16:3e:74:57:cb, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-b5af2db6-b78b-4ab7-93c3-ba817808e0f8 req-1b207143-2dc6-4bd1-8f9e-195e7d0a07f1 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-vif-unplugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b5af2db6-b78b-4ab7-93c3-ba817808e0f8 req-1b207143-2dc6-4bd1-8f9e-195e7d0a07f1 service nova] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b5af2db6-b78b-4ab7-93c3-ba817808e0f8 req-1b207143-2dc6-4bd1-8f9e-195e7d0a07f1 service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b5af2db6-b78b-4ab7-93c3-ba817808e0f8 req-1b207143-2dc6-4bd1-8f9e-195e7d0a07f1 service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-b5af2db6-b78b-4ab7-93c3-ba817808e0f8 req-1b207143-2dc6-4bd1-8f9e-195e7d0a07f1 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] No waiting events found dispatching network-vif-unplugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:18 user nova-compute[75100]: WARNING nova.compute.manager [req-b5af2db6-b78b-4ab7-93c3-ba817808e0f8 req-1b207143-2dc6-4bd1-8f9e-195e7d0a07f1 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received unexpected event network-vif-unplugged-bde2a813-7715-4fc1-a99e-f3cc8484988b for instance with vm_state active and task_state reboot_started.
Nov 13 17:39:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-cc8dc433-9999-401e-a9ba-2ccbe5344d5a tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "81c970a1-23fd-4cda-a532-a40811e85e11" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.847s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Successfully updated port: a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "refresh_cache-009a667b-e7aa-480e-8b81-76001a1434f9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquired lock "refresh_cache-009a667b-e7aa-480e-8b81-76001a1434f9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-5ec80856-e8ce-4b17-a4d2-be41e5664d98 req-d88923d6-d378-4492-8c6f-9f6489e82538 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Received event network-changed-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-5ec80856-e8ce-4b17-a4d2-be41e5664d98 req-d88923d6-d378-4492-8c6f-9f6489e82538 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Refreshing instance network info cache due to event network-changed-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5ec80856-e8ce-4b17-a4d2-be41e5664d98 req-d88923d6-d378-4492-8c6f-9f6489e82538 service nova] Acquiring lock "refresh_cache-009a667b-e7aa-480e-8b81-76001a1434f9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:39:18 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Instance shutdown successfully.
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Updating instance_info_cache with network_info: [{"id": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "address": "fa:16:3e:41:15:14", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a7cc98-67", "ovs_interfaceid": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Releasing lock "refresh_cache-009a667b-e7aa-480e-8b81-76001a1434f9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Instance network_info: |[{"id": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "address": "fa:16:3e:41:15:14", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a7cc98-67", "ovs_interfaceid": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5ec80856-e8ce-4b17-a4d2-be41e5664d98 req-d88923d6-d378-4492-8c6f-9f6489e82538 service nova] Acquired lock "refresh_cache-009a667b-e7aa-480e-8b81-76001a1434f9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.network.neutron [req-5ec80856-e8ce-4b17-a4d2-be41e5664d98 req-d88923d6-d378-4492-8c6f-9f6489e82538 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Refreshing network info cache for port a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Start _get_guest_xml network_info=[{"id": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "address": "fa:16:3e:41:15:14", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a7cc98-67", "ovs_interfaceid": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:39:18 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:39:18 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:39:18 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:39:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-13813907',display_name='tempest-ServersNegativeTestJSON-server-13813907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-13813907',id=40,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='047cedafb8344129a644233034fef4f4',ramdisk_id='',reservation_id='r-a5uz1obp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1990231420',owner_user_name='tempest-ServersNegativeTestJSON-1990231420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:39:17Z,user_data=None,user_id='380d78e868b44598aa311630ce34e0d1',uuid=009a667b-e7aa-480e-8b81-76001a1434f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "address": "fa:16:3e:41:15:14", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a7cc98-67", "ovs_interfaceid": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Converting VIF {"id": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "address": "fa:16:3e:41:15:14", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a7cc98-67", "ovs_interfaceid": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:15:14,bridge_name='br-int',has_traffic_filtering=True,id=a9a7cc98-677e-4f6f-b60b-cd4b7fbac585,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a7cc98-67') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG nova.objects.instance [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lazy-loading 'pci_devices' on Instance uuid 009a667b-e7aa-480e-8b81-76001a1434f9 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:39:19 user nova-compute[75100]:   <uuid>009a667b-e7aa-480e-8b81-76001a1434f9</uuid>
Nov 13 17:39:19 user nova-compute[75100]:   <name>instance-00000028</name>
Nov 13 17:39:19 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:39:19 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:39:19 user nova-compute[75100]:   <metadata>
Nov 13 17:39:19 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:39:19 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:39:19 user nova-compute[75100]:       <nova:name>tempest-ServersNegativeTestJSON-server-13813907</nova:name>
Nov 13 17:39:19 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:39:18</nova:creationTime>
Nov 13 17:39:19 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:39:19 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:39:19 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:39:19 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:39:19 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:39:19 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:39:19 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:39:19 user nova-compute[75100]:       <nova:owner>
Nov 13 17:39:19 user nova-compute[75100]:         <nova:user uuid="380d78e868b44598aa311630ce34e0d1">tempest-ServersNegativeTestJSON-1990231420-project-member</nova:user>
Nov 13 17:39:19 user nova-compute[75100]:         <nova:project uuid="047cedafb8344129a644233034fef4f4">tempest-ServersNegativeTestJSON-1990231420</nova:project>
Nov 13 17:39:19 user nova-compute[75100]:       </nova:owner>
Nov 13 17:39:19 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:39:19 user nova-compute[75100]:       <nova:ports>
Nov 13 17:39:19 user nova-compute[75100]:         <nova:port uuid="a9a7cc98-677e-4f6f-b60b-cd4b7fbac585">
Nov 13 17:39:19 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:39:19 user nova-compute[75100]:         </nova:port>
Nov 13 17:39:19 user nova-compute[75100]:       </nova:ports>
Nov 13 17:39:19 user nova-compute[75100]:     </nova:instance>
Nov 13 17:39:19 user nova-compute[75100]:   </metadata>
Nov 13 17:39:19 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:39:19 user nova-compute[75100]:     <system>
Nov 13 17:39:19 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:39:19 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:39:19 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:39:19 user nova-compute[75100]:       <entry name="serial">009a667b-e7aa-480e-8b81-76001a1434f9</entry>
Nov 13 17:39:19 user nova-compute[75100]:       <entry name="uuid">009a667b-e7aa-480e-8b81-76001a1434f9</entry>
Nov 13 17:39:19 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:39:19 user nova-compute[75100]:     </system>
Nov 13 17:39:19 user nova-compute[75100]:   </sysinfo>
Nov 13 17:39:19 user nova-compute[75100]:   <os>
Nov 13 17:39:19 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:39:19 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:39:19 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:39:19 user nova-compute[75100]:   </os>
Nov 13 17:39:19 user nova-compute[75100]:   <features>
Nov 13 17:39:19 user nova-compute[75100]:     <acpi/>
Nov 13 17:39:19 user nova-compute[75100]:     <apic/>
Nov 13 17:39:19 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:39:19 user nova-compute[75100]:   </features>
Nov 13 17:39:19 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:39:19 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:39:19 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:39:19 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:39:19 user nova-compute[75100]:   </clock>
Nov 13 17:39:19 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:39:19 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:39:19 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:39:19 user nova-compute[75100]:   </cpu>
Nov 13 17:39:19 user nova-compute[75100]:   <devices>
Nov 13 17:39:19 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:39:19 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:39:19 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk"/>
Nov 13 17:39:19 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:39:19 user nova-compute[75100]:     </disk>
Nov 13 17:39:19 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:39:19 user nova-compute[75100]:       <mac address="fa:16:3e:41:15:14"/>
Nov 13 17:39:19 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:39:19 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:39:19 user nova-compute[75100]:       <target dev="tapa9a7cc98-67"/>
Nov 13 17:39:19 user nova-compute[75100]:     </interface>
Nov 13 17:39:19 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:39:19 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/console.log" append="off"/>
Nov 13 17:39:19 user nova-compute[75100]:     </serial>
Nov 13 17:39:19 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:39:19 user nova-compute[75100]:     <video>
Nov 13 17:39:19 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:39:19 user nova-compute[75100]:     </video>
Nov 13 17:39:19 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:39:19 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:39:19 user nova-compute[75100]:     </rng>
Nov 13 17:39:19 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:39:19 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:39:19 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:39:19 user nova-compute[75100]:     </memballoon>
Nov 13 17:39:19 user nova-compute[75100]:   </devices>
Nov 13 17:39:19 user nova-compute[75100]: </domain>
Nov 13 17:39:19 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:39:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-13813907',display_name='tempest-ServersNegativeTestJSON-server-13813907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-13813907',id=40,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='047cedafb8344129a644233034fef4f4',ramdisk_id='',reservation_id='r-a5uz1obp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1990231420',owner_user_name='tempest-ServersNegativeTestJSON-1990231420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:39:17Z,user_data=None,user_id='380d78e868b44598aa311630ce34e0d1',uuid=009a667b-e7aa-480e-8b81-76001a1434f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "address": "fa:16:3e:41:15:14", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a7cc98-67", "ovs_interfaceid": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Converting VIF {"id": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "address": "fa:16:3e:41:15:14", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a7cc98-67", "ovs_interfaceid": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:15:14,bridge_name='br-int',has_traffic_filtering=True,id=a9a7cc98-677e-4f6f-b60b-cd4b7fbac585,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a7cc98-67') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG os_vif [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:15:14,bridge_name='br-int',has_traffic_filtering=True,id=a9a7cc98-677e-4f6f-b60b-cd4b7fbac585,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a7cc98-67') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6bfeca92-c88a-5131-93e3-d505b3d1ccbd', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9a7cc98-67, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9a7cc98-67, col_values=(('qos', UUID('2e346e4b-2b53-484e-b127-a6d8f5446300')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9a7cc98-67, col_values=(('external_ids', {'iface-id': 'a9a7cc98-677e-4f6f-b60b-cd4b7fbac585', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:15:14', 'vm-uuid': '009a667b-e7aa-480e-8b81-76001a1434f9'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:19 user nova-compute[75100]: INFO os_vif [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:15:14,bridge_name='br-int',has_traffic_filtering=True,id=a9a7cc98-677e-4f6f-b60b-cd4b7fbac585,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a7cc98-67')
Nov 13 17:39:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] No VIF found with MAC fa:16:3e:41:15:14, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-5ec80856-e8ce-4b17-a4d2-be41e5664d98 req-d88923d6-d378-4492-8c6f-9f6489e82538 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Updated VIF entry in instance network info cache for port a9a7cc98-677e-4f6f-b60b-cd4b7fbac585. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-5ec80856-e8ce-4b17-a4d2-be41e5664d98 req-d88923d6-d378-4492-8c6f-9f6489e82538 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Updating instance_info_cache with network_info: [{"id": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "address": "fa:16:3e:41:15:14", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a7cc98-67", "ovs_interfaceid": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5ec80856-e8ce-4b17-a4d2-be41e5664d98 req-d88923d6-d378-4492-8c6f-9f6489e82538 service nova] Releasing lock "refresh_cache-009a667b-e7aa-480e-8b81-76001a1434f9" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:39:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-98eaa0df-af39-4530-8673-40037698061d req-a04db743-e605-44e4-9dad-731961bdcd3c service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-98eaa0df-af39-4530-8673-40037698061d req-a04db743-e605-44e4-9dad-731961bdcd3c service nova] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-98eaa0df-af39-4530-8673-40037698061d req-a04db743-e605-44e4-9dad-731961bdcd3c service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-98eaa0df-af39-4530-8673-40037698061d req-a04db743-e605-44e4-9dad-731961bdcd3c service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-98eaa0df-af39-4530-8673-40037698061d req-a04db743-e605-44e4-9dad-731961bdcd3c service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] No waiting events found dispatching network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:20 user nova-compute[75100]: WARNING nova.compute.manager [req-98eaa0df-af39-4530-8673-40037698061d req-a04db743-e605-44e4-9dad-731961bdcd3c service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received unexpected event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b for instance with vm_state active and task_state reboot_started.
Nov 13 17:39:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "9b73aa60-0376-4499-8dd8-90db5f5d544b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:39:23 user nova-compute[75100]: INFO nova.compute.claims [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Claim successful on node user
Nov 13 17:39:23 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:39:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:39:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG nova.policy [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fde156049464deba4b3a3125712baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6352bffe5fa144f996e2ba07f69f4ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:39:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Creating image(s)
Nov 13 17:39:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "/opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "/opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk 1073741824" returned: 0 in 0.054s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Instance running successfully.
Nov 13 17:39:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Instance soft rebooted successfully.
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3ff46a9b-83bc-49d1-8c49-cd9dd22266c3 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.762s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Instance spawned successfully.
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Cannot resize image /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Ensure instance console log exists: /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Successfully created port: 71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:39:24 user nova-compute[75100]: INFO nova.compute.manager [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Took 7.87 seconds to spawn the instance on the hypervisor.
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:39:24 user nova-compute[75100]: INFO nova.compute.manager [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Took 8.68 seconds to build instance.
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8c3d5904-006a-4735-b973-88453a66e87d tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "009a667b-e7aa-480e-8b81-76001a1434f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.778s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:24 user nova-compute[75100]: DEBUG nova.compute.manager [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:39:25 user nova-compute[75100]: INFO nova.compute.claims [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Claim successful on node user
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Successfully updated port: 71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "refresh_cache-9b73aa60-0376-4499-8dd8-90db5f5d544b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquired lock "refresh_cache-9b73aa60-0376-4499-8dd8-90db5f5d544b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-35d607b7-5f22-4ffb-b0c5-cbc026d5857c req-5115f028-48fe-49d6-a47e-c23a7c005071 service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Received event network-changed-71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-35d607b7-5f22-4ffb-b0c5-cbc026d5857c req-5115f028-48fe-49d6-a47e-c23a7c005071 service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Refreshing instance network info cache due to event network-changed-71e2d08e-c462-47aa-be0d-22e5d53b7d2b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-35d607b7-5f22-4ffb-b0c5-cbc026d5857c req-5115f028-48fe-49d6-a47e-c23a7c005071 service nova] Acquiring lock "refresh_cache-9b73aa60-0376-4499-8dd8-90db5f5d544b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:39:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.network.neutron [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Updating instance_info_cache with network_info: [{"id": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "address": "fa:16:3e:32:a1:31", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e2d08e-c4", "ovs_interfaceid": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Releasing lock "refresh_cache-9b73aa60-0376-4499-8dd8-90db5f5d544b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Instance network_info: |[{"id": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "address": "fa:16:3e:32:a1:31", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e2d08e-c4", "ovs_interfaceid": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-35d607b7-5f22-4ffb-b0c5-cbc026d5857c req-5115f028-48fe-49d6-a47e-c23a7c005071 service nova] Acquired lock "refresh_cache-9b73aa60-0376-4499-8dd8-90db5f5d544b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-35d607b7-5f22-4ffb-b0c5-cbc026d5857c req-5115f028-48fe-49d6-a47e-c23a7c005071 service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Refreshing network info cache for port 71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Start _get_guest_xml network_info=[{"id": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "address": "fa:16:3e:32:a1:31", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e2d08e-c4", "ovs_interfaceid": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:39:25 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:39:25 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-316497331',display_name='tempest-AttachVolumeNegativeTest-server-316497331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-316497331',id=41,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxTI/M0remiJjw0epgGH9ZoBikABFhkfbrsalsGMi7T5MVDAvn9pcFLt2d3YesLobdD9sS/+TicRZ5AW2wYuJHUQFavKDftSmiOeUV9aMdZd49Cy0w7lYcAWPWMb4Khkg==',key_name='tempest-keypair-1039454101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6352bffe5fa144f996e2ba07f69f4ee4',ramdisk_id='',reservation_id='r-c86eftky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2126330685',owner_user_name='tempest-AttachVolumeNegativeTest-2126330685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:39:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fde156049464deba4b3a3125712baa9',uuid=9b73aa60-0376-4499-8dd8-90db5f5d544b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "address": "fa:16:3e:32:a1:31", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e2d08e-c4", "ovs_interfaceid": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converting VIF {"id": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "address": "fa:16:3e:32:a1:31", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e2d08e-c4", "ovs_interfaceid": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:a1:31,bridge_name='br-int',has_traffic_filtering=True,id=71e2d08e-c462-47aa-be0d-22e5d53b7d2b,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e2d08e-c4') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.objects.instance [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b73aa60-0376-4499-8dd8-90db5f5d544b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.policy [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c54440f660c64141ad91285ddef65ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db67a12bfc7f48b380175a6871012f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:39:25 user nova-compute[75100]:   <uuid>9b73aa60-0376-4499-8dd8-90db5f5d544b</uuid>
Nov 13 17:39:25 user nova-compute[75100]:   <name>instance-00000029</name>
Nov 13 17:39:25 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:39:25 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:39:25 user nova-compute[75100]:   <metadata>
Nov 13 17:39:25 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:39:25 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:39:25 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeNegativeTest-server-316497331</nova:name>
Nov 13 17:39:25 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:39:25</nova:creationTime>
Nov 13 17:39:25 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:39:25 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:39:25 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:39:25 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:39:25 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:39:25 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:39:25 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:39:25 user nova-compute[75100]:       <nova:owner>
Nov 13 17:39:25 user nova-compute[75100]:         <nova:user uuid="9fde156049464deba4b3a3125712baa9">tempest-AttachVolumeNegativeTest-2126330685-project-member</nova:user>
Nov 13 17:39:25 user nova-compute[75100]:         <nova:project uuid="6352bffe5fa144f996e2ba07f69f4ee4">tempest-AttachVolumeNegativeTest-2126330685</nova:project>
Nov 13 17:39:25 user nova-compute[75100]:       </nova:owner>
Nov 13 17:39:25 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:39:25 user nova-compute[75100]:       <nova:ports>
Nov 13 17:39:25 user nova-compute[75100]:         <nova:port uuid="71e2d08e-c462-47aa-be0d-22e5d53b7d2b">
Nov 13 17:39:25 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 17:39:25 user nova-compute[75100]:         </nova:port>
Nov 13 17:39:25 user nova-compute[75100]:       </nova:ports>
Nov 13 17:39:25 user nova-compute[75100]:     </nova:instance>
Nov 13 17:39:25 user nova-compute[75100]:   </metadata>
Nov 13 17:39:25 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:39:25 user nova-compute[75100]:     <system>
Nov 13 17:39:25 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:39:25 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:39:25 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:39:25 user nova-compute[75100]:       <entry name="serial">9b73aa60-0376-4499-8dd8-90db5f5d544b</entry>
Nov 13 17:39:25 user nova-compute[75100]:       <entry name="uuid">9b73aa60-0376-4499-8dd8-90db5f5d544b</entry>
Nov 13 17:39:25 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:39:25 user nova-compute[75100]:     </system>
Nov 13 17:39:25 user nova-compute[75100]:   </sysinfo>
Nov 13 17:39:25 user nova-compute[75100]:   <os>
Nov 13 17:39:25 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:39:25 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:39:25 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:39:25 user nova-compute[75100]:   </os>
Nov 13 17:39:25 user nova-compute[75100]:   <features>
Nov 13 17:39:25 user nova-compute[75100]:     <acpi/>
Nov 13 17:39:25 user nova-compute[75100]:     <apic/>
Nov 13 17:39:25 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:39:25 user nova-compute[75100]:   </features>
Nov 13 17:39:25 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:39:25 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:39:25 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:39:25 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:39:25 user nova-compute[75100]:   </clock>
Nov 13 17:39:25 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:39:25 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:39:25 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:39:25 user nova-compute[75100]:   </cpu>
Nov 13 17:39:25 user nova-compute[75100]:   <devices>
Nov 13 17:39:25 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:39:25 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:39:25 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk"/>
Nov 13 17:39:25 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:39:25 user nova-compute[75100]:     </disk>
Nov 13 17:39:25 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:39:25 user nova-compute[75100]:       <mac address="fa:16:3e:32:a1:31"/>
Nov 13 17:39:25 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:39:25 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:39:25 user nova-compute[75100]:       <target dev="tap71e2d08e-c4"/>
Nov 13 17:39:25 user nova-compute[75100]:     </interface>
Nov 13 17:39:25 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:39:25 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/console.log" append="off"/>
Nov 13 17:39:25 user nova-compute[75100]:     </serial>
Nov 13 17:39:25 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:39:25 user nova-compute[75100]:     <video>
Nov 13 17:39:25 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:39:25 user nova-compute[75100]:     </video>
Nov 13 17:39:25 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:39:25 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:39:25 user nova-compute[75100]:     </rng>
Nov 13 17:39:25 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:39:25 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:39:25 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:39:25 user nova-compute[75100]:     </memballoon>
Nov 13 17:39:25 user nova-compute[75100]:   </devices>
Nov 13 17:39:25 user nova-compute[75100]: </domain>
Nov 13 17:39:25 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-316497331',display_name='tempest-AttachVolumeNegativeTest-server-316497331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-316497331',id=41,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxTI/M0remiJjw0epgGH9ZoBikABFhkfbrsalsGMi7T5MVDAvn9pcFLt2d3YesLobdD9sS/+TicRZ5AW2wYuJHUQFavKDftSmiOeUV9aMdZd49Cy0w7lYcAWPWMb4Khkg==',key_name='tempest-keypair-1039454101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6352bffe5fa144f996e2ba07f69f4ee4',ramdisk_id='',reservation_id='r-c86eftky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2126330685',owner_user_name='tempest-AttachVolumeNegativeTest-2126330685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:39:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fde156049464deba4b3a3125712baa9',uuid=9b73aa60-0376-4499-8dd8-90db5f5d544b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "address": "fa:16:3e:32:a1:31", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e2d08e-c4", "ovs_interfaceid": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converting VIF {"id": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "address": "fa:16:3e:32:a1:31", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e2d08e-c4", "ovs_interfaceid": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:a1:31,bridge_name='br-int',has_traffic_filtering=True,id=71e2d08e-c462-47aa-be0d-22e5d53b7d2b,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e2d08e-c4') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG os_vif [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:a1:31,bridge_name='br-int',has_traffic_filtering=True,id=71e2d08e-c462-47aa-be0d-22e5d53b7d2b,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e2d08e-c4') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1abd483-ff5e-5514-89a2-8591a2126537', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71e2d08e-c4, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71e2d08e-c4, col_values=(('qos', UUID('04735d29-0f2b-4ef9-8aa6-ad3a2dd93986')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71e2d08e-c4, col_values=(('external_ids', {'iface-id': '71e2d08e-c462-47aa-be0d-22e5d53b7d2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:a1:31', 'vm-uuid': '9b73aa60-0376-4499-8dd8-90db5f5d544b'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:25 user nova-compute[75100]: INFO os_vif [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:a1:31,bridge_name='br-int',has_traffic_filtering=True,id=71e2d08e-c462-47aa-be0d-22e5d53b7d2b,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e2d08e-c4')
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:39:25 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Creating image(s)
Nov 13 17:39:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "/opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "/opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:39:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No VIF found with MAC fa:16:3e:32:a1:31, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk 1073741824" returned: 0 in 0.050s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG nova.network.neutron [req-35d607b7-5f22-4ffb-b0c5-cbc026d5857c req-5115f028-48fe-49d6-a47e-c23a7c005071 service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Updated VIF entry in instance network info cache for port 71e2d08e-c462-47aa-be0d-22e5d53b7d2b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG nova.network.neutron [req-35d607b7-5f22-4ffb-b0c5-cbc026d5857c req-5115f028-48fe-49d6-a47e-c23a7c005071 service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Updating instance_info_cache with network_info: [{"id": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "address": "fa:16:3e:32:a1:31", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e2d08e-c4", "ovs_interfaceid": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Cannot resize image /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Ensure instance console log exists: /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.006s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-35d607b7-5f22-4ffb-b0c5-cbc026d5857c req-5115f028-48fe-49d6-a47e-c23a7c005071 service nova] Releasing lock "refresh_cache-9b73aa60-0376-4499-8dd8-90db5f5d544b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:39:26 user nova-compute[75100]: DEBUG nova.network.neutron [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Successfully created port: 8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:39:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-f6c8070b-b3d0-4ecf-9cdf-146fc4851fe8 req-cd37b551-12cf-44ea-9da4-36dccc745272 service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Received event network-vif-plugged-71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6c8070b-b3d0-4ecf-9cdf-146fc4851fe8 req-cd37b551-12cf-44ea-9da4-36dccc745272 service nova] Acquiring lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6c8070b-b3d0-4ecf-9cdf-146fc4851fe8 req-cd37b551-12cf-44ea-9da4-36dccc745272 service nova] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f6c8070b-b3d0-4ecf-9cdf-146fc4851fe8 req-cd37b551-12cf-44ea-9da4-36dccc745272 service nova] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-f6c8070b-b3d0-4ecf-9cdf-146fc4851fe8 req-cd37b551-12cf-44ea-9da4-36dccc745272 service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] No waiting events found dispatching network-vif-plugged-71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:27 user nova-compute[75100]: WARNING nova.compute.manager [req-f6c8070b-b3d0-4ecf-9cdf-146fc4851fe8 req-cd37b551-12cf-44ea-9da4-36dccc745272 service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Received unexpected event network-vif-plugged-71e2d08e-c462-47aa-be0d-22e5d53b7d2b for instance with vm_state building and task_state spawning.
Nov 13 17:39:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:27 user nova-compute[75100]: DEBUG nova.network.neutron [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Successfully updated port: 8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-3d3eb088-5203-46a0-a6c0-860dbc365ca9 req-97d084b0-2952-49c5-8744-95485ec9f56f service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-changed-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-3d3eb088-5203-46a0-a6c0-860dbc365ca9 req-97d084b0-2952-49c5-8744-95485ec9f56f service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Refreshing instance network info cache due to event network-changed-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3d3eb088-5203-46a0-a6c0-860dbc365ca9 req-97d084b0-2952-49c5-8744-95485ec9f56f service nova] Acquiring lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3d3eb088-5203-46a0-a6c0-860dbc365ca9 req-97d084b0-2952-49c5-8744-95485ec9f56f service nova] Acquired lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-3d3eb088-5203-46a0-a6c0-860dbc365ca9 req-97d084b0-2952-49c5-8744-95485ec9f56f service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Refreshing network info cache for port 8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-3d3eb088-5203-46a0-a6c0-860dbc365ca9 req-97d084b0-2952-49c5-8744-95485ec9f56f service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-9a4a8f38-842b-4b35-8aca-d90d0c2339be req-d69e70ef-be55-4d97-9d76-78f2d9d3a9bb service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a4a8f38-842b-4b35-8aca-d90d0c2339be req-d69e70ef-be55-4d97-9d76-78f2d9d3a9bb service nova] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a4a8f38-842b-4b35-8aca-d90d0c2339be req-d69e70ef-be55-4d97-9d76-78f2d9d3a9bb service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9a4a8f38-842b-4b35-8aca-d90d0c2339be req-d69e70ef-be55-4d97-9d76-78f2d9d3a9bb service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.compute.manager [req-9a4a8f38-842b-4b35-8aca-d90d0c2339be req-d69e70ef-be55-4d97-9d76-78f2d9d3a9bb service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] No waiting events found dispatching network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:28 user nova-compute[75100]: WARNING nova.compute.manager [req-9a4a8f38-842b-4b35-8aca-d90d0c2339be req-d69e70ef-be55-4d97-9d76-78f2d9d3a9bb service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received unexpected event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b for instance with vm_state active and task_state None.
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.network.neutron [req-3d3eb088-5203-46a0-a6c0-860dbc365ca9 req-97d084b0-2952-49c5-8744-95485ec9f56f service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3d3eb088-5203-46a0-a6c0-860dbc365ca9 req-97d084b0-2952-49c5-8744-95485ec9f56f service nova] Releasing lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquired lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updating instance_info_cache with network_info: [{"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Releasing lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Instance network_info: |[{"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Start _get_guest_xml network_info=[{"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:39:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:39:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2002205144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2002205144',id=42,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw5/1O+7fCYlXt2eQaRgEJLZ4+j1NCpqqWKg3tOzqMfKiv6ItQM1MSBVha+jLGvqqFyBNuibAfc5etB/s5ejgZZQK5kstmOid0WnRHZWrwqF2GYhsMRpGVp8JeJfpfkZQ==',key_name='tempest-keypair-457334197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db67a12bfc7f48b380175a6871012f25',ramdisk_id='',reservation_id='r-senzr9dj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1414200693',owner_user_name='tempest-AttachVolumeShelveTestJSON-1414200693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54440f660c64141ad91285ddef65ca9',uuid=6a32f8b7-2e32-42a7-b600-fc88bcc577fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converting VIF {"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.objects.instance [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a32f8b7-2e32-42a7-b600-fc88bcc577fd {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:39:28 user nova-compute[75100]:   <uuid>6a32f8b7-2e32-42a7-b600-fc88bcc577fd</uuid>
Nov 13 17:39:28 user nova-compute[75100]:   <name>instance-0000002a</name>
Nov 13 17:39:28 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:39:28 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:39:28 user nova-compute[75100]:   <metadata>
Nov 13 17:39:28 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:39:28 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:39:28 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2002205144</nova:name>
Nov 13 17:39:28 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:39:28</nova:creationTime>
Nov 13 17:39:28 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:39:28 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:39:28 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:39:28 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:39:28 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:39:28 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:39:28 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:39:28 user nova-compute[75100]:       <nova:owner>
Nov 13 17:39:28 user nova-compute[75100]:         <nova:user uuid="c54440f660c64141ad91285ddef65ca9">tempest-AttachVolumeShelveTestJSON-1414200693-project-member</nova:user>
Nov 13 17:39:28 user nova-compute[75100]:         <nova:project uuid="db67a12bfc7f48b380175a6871012f25">tempest-AttachVolumeShelveTestJSON-1414200693</nova:project>
Nov 13 17:39:28 user nova-compute[75100]:       </nova:owner>
Nov 13 17:39:28 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:39:28 user nova-compute[75100]:       <nova:ports>
Nov 13 17:39:28 user nova-compute[75100]:         <nova:port uuid="8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac">
Nov 13 17:39:28 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 17:39:28 user nova-compute[75100]:         </nova:port>
Nov 13 17:39:28 user nova-compute[75100]:       </nova:ports>
Nov 13 17:39:28 user nova-compute[75100]:     </nova:instance>
Nov 13 17:39:28 user nova-compute[75100]:   </metadata>
Nov 13 17:39:28 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:39:28 user nova-compute[75100]:     <system>
Nov 13 17:39:28 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:39:28 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:39:28 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:39:28 user nova-compute[75100]:       <entry name="serial">6a32f8b7-2e32-42a7-b600-fc88bcc577fd</entry>
Nov 13 17:39:28 user nova-compute[75100]:       <entry name="uuid">6a32f8b7-2e32-42a7-b600-fc88bcc577fd</entry>
Nov 13 17:39:28 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:39:28 user nova-compute[75100]:     </system>
Nov 13 17:39:28 user nova-compute[75100]:   </sysinfo>
Nov 13 17:39:28 user nova-compute[75100]:   <os>
Nov 13 17:39:28 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:39:28 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:39:28 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:39:28 user nova-compute[75100]:   </os>
Nov 13 17:39:28 user nova-compute[75100]:   <features>
Nov 13 17:39:28 user nova-compute[75100]:     <acpi/>
Nov 13 17:39:28 user nova-compute[75100]:     <apic/>
Nov 13 17:39:28 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:39:28 user nova-compute[75100]:   </features>
Nov 13 17:39:28 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:39:28 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:39:28 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:39:28 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:39:28 user nova-compute[75100]:   </clock>
Nov 13 17:39:28 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:39:28 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:39:28 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:39:28 user nova-compute[75100]:   </cpu>
Nov 13 17:39:28 user nova-compute[75100]:   <devices>
Nov 13 17:39:28 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:39:28 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:39:28 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk"/>
Nov 13 17:39:28 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:39:28 user nova-compute[75100]:     </disk>
Nov 13 17:39:28 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:39:28 user nova-compute[75100]:       <mac address="fa:16:3e:11:8d:15"/>
Nov 13 17:39:28 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:39:28 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:39:28 user nova-compute[75100]:       <target dev="tap8fbe0d9f-51"/>
Nov 13 17:39:28 user nova-compute[75100]:     </interface>
Nov 13 17:39:28 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:39:28 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/console.log" append="off"/>
Nov 13 17:39:28 user nova-compute[75100]:     </serial>
Nov 13 17:39:28 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:39:28 user nova-compute[75100]:     <video>
Nov 13 17:39:28 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:39:28 user nova-compute[75100]:     </video>
Nov 13 17:39:28 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:39:28 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:39:28 user nova-compute[75100]:     </rng>
Nov 13 17:39:28 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:39:28 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:39:28 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:39:28 user nova-compute[75100]:     </memballoon>
Nov 13 17:39:28 user nova-compute[75100]:   </devices>
Nov 13 17:39:28 user nova-compute[75100]: </domain>
Nov 13 17:39:28 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2002205144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2002205144',id=42,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw5/1O+7fCYlXt2eQaRgEJLZ4+j1NCpqqWKg3tOzqMfKiv6ItQM1MSBVha+jLGvqqFyBNuibAfc5etB/s5ejgZZQK5kstmOid0WnRHZWrwqF2GYhsMRpGVp8JeJfpfkZQ==',key_name='tempest-keypair-457334197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db67a12bfc7f48b380175a6871012f25',ramdisk_id='',reservation_id='r-senzr9dj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1414200693',owner_user_name='tempest-AttachVolumeShelveTestJSON-1414200693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54440f660c64141ad91285ddef65ca9',uuid=6a32f8b7-2e32-42a7-b600-fc88bcc577fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converting VIF {"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG os_vif [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c55f37de-733b-5d92-8fa4-1bf463a49b17', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fbe0d9f-51, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fbe0d9f-51, col_values=(('qos', UUID('ddd4e5b8-06f8-435e-9a6e-a757ad1f0c5f')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fbe0d9f-51, col_values=(('external_ids', {'iface-id': '8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:8d:15', 'vm-uuid': '6a32f8b7-2e32-42a7-b600-fc88bcc577fd'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:28 user nova-compute[75100]: INFO os_vif [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51')
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:39:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] No VIF found with MAC fa:16:3e:11:8d:15, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:39:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-e06f9273-e598-4d6a-a6ca-3ceca84afbdf req-98175c85-3286-4052-b956-b5d210717e6e service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Received event network-vif-plugged-71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e06f9273-e598-4d6a-a6ca-3ceca84afbdf req-98175c85-3286-4052-b956-b5d210717e6e service nova] Acquiring lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e06f9273-e598-4d6a-a6ca-3ceca84afbdf req-98175c85-3286-4052-b956-b5d210717e6e service nova] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e06f9273-e598-4d6a-a6ca-3ceca84afbdf req-98175c85-3286-4052-b956-b5d210717e6e service nova] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-e06f9273-e598-4d6a-a6ca-3ceca84afbdf req-98175c85-3286-4052-b956-b5d210717e6e service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] No waiting events found dispatching network-vif-plugged-71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:29 user nova-compute[75100]: WARNING nova.compute.manager [req-e06f9273-e598-4d6a-a6ca-3ceca84afbdf req-98175c85-3286-4052-b956-b5d210717e6e service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Received unexpected event network-vif-plugged-71e2d08e-c462-47aa-be0d-22e5d53b7d2b for instance with vm_state building and task_state spawning.
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:39:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Instance spawned successfully.
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:30 user nova-compute[75100]: INFO nova.compute.manager [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:39:30 user nova-compute[75100]: INFO nova.compute.manager [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Took 7.26 seconds to build instance.
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3dd93fa5-535a-47e0-8fae-03133ffa1e5c tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.371s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] No waiting events found dispatching network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:30 user nova-compute[75100]: WARNING nova.compute.manager [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received unexpected event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b for instance with vm_state active and task_state None.
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Received event network-vif-plugged-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] Acquiring lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] Lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] Lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] No waiting events found dispatching network-vif-plugged-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:30 user nova-compute[75100]: WARNING nova.compute.manager [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Received unexpected event network-vif-plugged-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 for instance with vm_state active and task_state None.
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Received event network-vif-plugged-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] Acquiring lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] Lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] Lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] No waiting events found dispatching network-vif-plugged-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:30 user nova-compute[75100]: WARNING nova.compute.manager [req-3c1cdc08-a2d3-481f-8d17-ffd74e8734cb req-a34636e8-82c2-4cf4-bb16-228f16abd5a4 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Received unexpected event network-vif-plugged-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 for instance with vm_state active and task_state None.
Nov 13 17:39:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-16af7dea-618d-49f9-b0f2-5c0b0b77e2d4 req-ae1d3c97-96dd-470e-abf2-08a85fb50c06 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-16af7dea-618d-49f9-b0f2-5c0b0b77e2d4 req-ae1d3c97-96dd-470e-abf2-08a85fb50c06 service nova] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-16af7dea-618d-49f9-b0f2-5c0b0b77e2d4 req-ae1d3c97-96dd-470e-abf2-08a85fb50c06 service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-16af7dea-618d-49f9-b0f2-5c0b0b77e2d4 req-ae1d3c97-96dd-470e-abf2-08a85fb50c06 service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-16af7dea-618d-49f9-b0f2-5c0b0b77e2d4 req-ae1d3c97-96dd-470e-abf2-08a85fb50c06 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] No waiting events found dispatching network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:30 user nova-compute[75100]: WARNING nova.compute.manager [req-16af7dea-618d-49f9-b0f2-5c0b0b77e2d4 req-ae1d3c97-96dd-470e-abf2-08a85fb50c06 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received unexpected event network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac for instance with vm_state building and task_state spawning.
Nov 13 17:39:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-993579c0-91ee-4a54-920c-948cdd471425 req-ee42d7c1-b68f-4a8b-a040-06862ca941de service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-993579c0-91ee-4a54-920c-948cdd471425 req-ee42d7c1-b68f-4a8b-a040-06862ca941de service nova] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-993579c0-91ee-4a54-920c-948cdd471425 req-ee42d7c1-b68f-4a8b-a040-06862ca941de service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-993579c0-91ee-4a54-920c-948cdd471425 req-ee42d7c1-b68f-4a8b-a040-06862ca941de service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-993579c0-91ee-4a54-920c-948cdd471425 req-ee42d7c1-b68f-4a8b-a040-06862ca941de service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] No waiting events found dispatching network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:32 user nova-compute[75100]: WARNING nova.compute.manager [req-993579c0-91ee-4a54-920c-948cdd471425 req-ee42d7c1-b68f-4a8b-a040-06862ca941de service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received unexpected event network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac for instance with vm_state building and task_state spawning.
Nov 13 17:39:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:39:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Instance spawned successfully.
Nov 13 17:39:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:39:32 user nova-compute[75100]: INFO nova.compute.manager [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 13 17:39:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:39:33 user nova-compute[75100]: INFO nova.compute.manager [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Took 7.99 seconds to build instance.
Nov 13 17:39:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-56747612-0ddd-44e3-a3e7-28d9d9c7a785 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.087s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:39:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:39:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:39:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:39:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:39:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:39:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:35 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:39:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:39:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:36 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:39:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:39:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:39:40 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:39:40 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7948MB free_disk=25.03302001953125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 81c970a1-23fd-4cda-a532-a40811e85e11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f0bf103e-23eb-486a-a5df-9f3e66d4d076 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f589271c-7e6c-4352-8b85-8a7aca61dc7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 009a667b-e7aa-480e-8b81-76001a1434f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 9b73aa60-0376-4499-8dd8-90db5f5d544b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:39:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:39:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:39:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:39:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:39:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:39:42 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:39:42 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:39:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:43 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Updating instance_info_cache with network_info: [{"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:39:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:39:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:39:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:39:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:39:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:54 user nova-compute[75100]: INFO nova.compute.manager [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Terminating instance
Nov 13 17:39:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-b66cd3ae-8a4b-40de-a1fe-c96b76834636 req-4751ad48-5e10-4ad9-a258-946942f08eb0 service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Received event network-vif-unplugged-d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b66cd3ae-8a4b-40de-a1fe-c96b76834636 req-4751ad48-5e10-4ad9-a258-946942f08eb0 service nova] Acquiring lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b66cd3ae-8a4b-40de-a1fe-c96b76834636 req-4751ad48-5e10-4ad9-a258-946942f08eb0 service nova] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b66cd3ae-8a4b-40de-a1fe-c96b76834636 req-4751ad48-5e10-4ad9-a258-946942f08eb0 service nova] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-b66cd3ae-8a4b-40de-a1fe-c96b76834636 req-4751ad48-5e10-4ad9-a258-946942f08eb0 service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] No waiting events found dispatching network-vif-unplugged-d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-b66cd3ae-8a4b-40de-a1fe-c96b76834636 req-4751ad48-5e10-4ad9-a258-946942f08eb0 service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Received event network-vif-unplugged-d655d771-6c6c-49e9-89da-810f79e78314 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:39:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Instance destroyed successfully.
Nov 13 17:39:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lazy-loading 'resources' on Instance uuid ad5356a6-48bb-4aa5-8ccb-06ef577b9b44 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:19:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2025403910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2025403910',id=4,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1bf7bde4b774e3dac46d41d32496efa',ramdisk_id='',reservation_id='r-rfalet2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:21:24Z,user_data=None,user_id='77f5fd132c0e46438884eaffae0beab9',uuid=ad5356a6-48bb-4aa5-8ccb-06ef577b9b44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converting VIF {"id": "d655d771-6c6c-49e9-89da-810f79e78314", "address": "fa:16:3e:33:08:c3", "network": {"id": "db346b3d-14fb-4783-9797-aefae245b618", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1889670565-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1bf7bde4b774e3dac46d41d32496efa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd655d771-6c", "ovs_interfaceid": "d655d771-6c6c-49e9-89da-810f79e78314", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:08:c3,bridge_name='br-int',has_traffic_filtering=True,id=d655d771-6c6c-49e9-89da-810f79e78314,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd655d771-6c') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG os_vif [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:08:c3,bridge_name='br-int',has_traffic_filtering=True,id=d655d771-6c6c-49e9-89da-810f79e78314,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd655d771-6c') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd655d771-6c, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b1d5fc9-f6ad-40a5-a4af-abb953e0cdb2) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:39:55 user nova-compute[75100]: INFO os_vif [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:08:c3,bridge_name='br-int',has_traffic_filtering=True,id=d655d771-6c6c-49e9-89da-810f79e78314,network=Network(db346b3d-14fb-4783-9797-aefae245b618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd655d771-6c')
Nov 13 17:39:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Deleting instance files /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44_del
Nov 13 17:39:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Deletion of /opt/stack/data/nova/instances/ad5356a6-48bb-4aa5-8ccb-06ef577b9b44_del complete
Nov 13 17:39:55 user nova-compute[75100]: INFO nova.compute.manager [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 13 17:39:55 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:39:55 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Took 0.46 seconds to deallocate network for instance.
Nov 13 17:39:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-41662c37-dc39-4f0f-b2c3-6fa166a380e0 req-fca045f4-5649-456c-a10f-4de10f1eb554 service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Received event network-vif-deleted-d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:56 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:39:56 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:39:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:56 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Deleted allocations for instance ad5356a6-48bb-4aa5-8ccb-06ef577b9b44
Nov 13 17:39:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-da9c6d90-6d4e-4537-9528-a1e3d208f9ca tempest-ServerBootFromVolumeStableRescueTest-1217233624 tempest-ServerBootFromVolumeStableRescueTest-1217233624-project-member] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.834s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-0d6a09cd-d3b0-4135-bc41-f8b39df9af09 req-56e05c51-83f2-41e7-9dd9-accf8631ad06 service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Received event network-vif-plugged-d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:39:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0d6a09cd-d3b0-4135-bc41-f8b39df9af09 req-56e05c51-83f2-41e7-9dd9-accf8631ad06 service nova] Acquiring lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:39:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0d6a09cd-d3b0-4135-bc41-f8b39df9af09 req-56e05c51-83f2-41e7-9dd9-accf8631ad06 service nova] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:39:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0d6a09cd-d3b0-4135-bc41-f8b39df9af09 req-56e05c51-83f2-41e7-9dd9-accf8631ad06 service nova] Lock "ad5356a6-48bb-4aa5-8ccb-06ef577b9b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:39:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-0d6a09cd-d3b0-4135-bc41-f8b39df9af09 req-56e05c51-83f2-41e7-9dd9-accf8631ad06 service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] No waiting events found dispatching network-vif-plugged-d655d771-6c6c-49e9-89da-810f79e78314 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:39:56 user nova-compute[75100]: WARNING nova.compute.manager [req-0d6a09cd-d3b0-4135-bc41-f8b39df9af09 req-56e05c51-83f2-41e7-9dd9-accf8631ad06 service nova] [instance: ad5356a6-48bb-4aa5-8ccb-06ef577b9b44] Received unexpected event network-vif-plugged-d655d771-6c6c-49e9-89da-810f79e78314 for instance with vm_state deleted and task_state None.
Nov 13 17:39:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:40:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:40:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:40:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:40:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:40:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:40:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:40:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:40:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:40:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:40:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:32 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:40:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:40:34 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:40:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 17:40:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 17:40:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:40:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:40:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:40:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:40:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:40:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:40:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:40:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:40:37 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updating instance_info_cache with network_info: [{"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:38 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-a4e55eab-6f13-467a-a504-06df019226d5 req-c5530d9a-e497-4001-9774-c8f533741995 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received event network-changed-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-a4e55eab-6f13-467a-a504-06df019226d5 req-c5530d9a-e497-4001-9774-c8f533741995 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Refreshing instance network info cache due to event network-changed-dec33d9c-57c8-41a4-a519-c1b6712c80f6. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a4e55eab-6f13-467a-a504-06df019226d5 req-c5530d9a-e497-4001-9774-c8f533741995 service nova] Acquiring lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a4e55eab-6f13-467a-a504-06df019226d5 req-c5530d9a-e497-4001-9774-c8f533741995 service nova] Acquired lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG nova.network.neutron [req-a4e55eab-6f13-467a-a504-06df019226d5 req-c5530d9a-e497-4001-9774-c8f533741995 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Refreshing network info cache for port dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG nova.network.neutron [req-a4e55eab-6f13-467a-a504-06df019226d5 req-c5530d9a-e497-4001-9774-c8f533741995 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Updated VIF entry in instance network info cache for port dec33d9c-57c8-41a4-a519-c1b6712c80f6. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG nova.network.neutron [req-a4e55eab-6f13-467a-a504-06df019226d5 req-c5530d9a-e497-4001-9774-c8f533741995 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Updating instance_info_cache with network_info: [{"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a4e55eab-6f13-467a-a504-06df019226d5 req-c5530d9a-e497-4001-9774-c8f533741995 service nova] Releasing lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lazy-loading 'flavor' on Instance uuid f589271c-7e6c-4352-8b85-8a7aca61dc7f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:40:40 user nova-compute[75100]: INFO nova.compute.manager [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Attaching volume 5870cd8c-a5eb-4ef8-92fc-337d869a2665 to /dev/vdb
Nov 13 17:40:40 user nova-compute[75100]: DEBUG os_brick.utils [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e1d034-d35f-46d3-9211-c584ec3332f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[46682568-7cdc-4946-a966-190fb563dfb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad96a02-ece9-4ad0-b6f6-b081c52ab884]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[50979bf3-c491-4633-9bf7-6cb97ad5044c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:40:40 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10a62f3-c16c-42a4-a8d4-5427fcea5429]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG os_brick.utils [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Updating existing volume attachment record: 39ca3d89-a477-4186-9c94-d484a1025ffc {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:40:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:40:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=7981MB free_disk=25.07327651977539GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 81c970a1-23fd-4cda-a532-a40811e85e11 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f0bf103e-23eb-486a-a5df-9f3e66d4d076 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f589271c-7e6c-4352-8b85-8a7aca61dc7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 009a667b-e7aa-480e-8b81-76001a1434f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 9b73aa60-0376-4499-8dd8-90db5f5d544b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing inventories for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating ProviderTree inventory for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating inventory in ProviderTree for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing aggregate associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing trait associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:40:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:40:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJmHVSAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:40:44 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:40:44 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:40:44 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3853d70-a4e6-4127-b74b-98baca08cba1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:40:44 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5546142-0d77-49b9-b0b6-7c945d55757f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665] added
Nov 13 17:40:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee23ea8-ba93-452a-b2b9-aec6a14c2253]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[272a78f8-cb6c-47e8-a954-debc632a0411]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJmHVSAD {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJmHVSAD" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c750eb5a-c15e-40f0-a546-62c3581e8f99]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gJmHVSAD'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1410b449-37b3-4e49-bdcf-a350a93adff9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c4d20-a5b3-4493-ac56-885b8d148431]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:40:44 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)
Nov 13 17:40:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:40:44 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)
Nov 13 17:40:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d34b77d-5585-4253-86d7-daf1fe38363d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665, portal: 172.16.0.220,3260]
Nov 13 17:40:44 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665, portal: 172.16.0.220,3260] successful.
Nov 13 17:40:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51a946c-0069-4d81-b4e0-401d5b897265]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8137ce39-f365-480a-9827-1945403cd50e]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:40:44 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)
Nov 13 17:40:44 user nova-compute[75100]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 (non-flash)
Nov 13 17:40:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:40:44 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)
Nov 13 17:40:44 user nova-compute[75100]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 (non-flash)
Nov 13 17:40:44 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:40:44 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfab7a71-f526-4429-b567-90eebd9dda6d]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:40:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:40:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:40:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:40:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:40:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJmHVSAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:40:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:40:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26164346366366336', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:40:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164346366366336', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:40:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lazy-loading 'flavor' on Instance uuid f589271c-7e6c-4352-8b85-8a7aca61dc7f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:40:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:40:46 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:40:46 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 13 17:40:46 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:40:46 user nova-compute[75100]:   <serial>5870cd8c-a5eb-4ef8-92fc-337d869a2665</serial>
Nov 13 17:40:46 user nova-compute[75100]: </disk>
Nov 13 17:40:46 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:40:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:40:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:40:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] No VIF found with MAC fa:16:3e:e1:46:73, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:40:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-48ca4256-05d1-46f3-a009-c482a13a0747 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.975s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:40:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:40:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:40:48 user nova-compute[75100]: INFO nova.compute.manager [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Detaching volume 5870cd8c-a5eb-4ef8-92fc-337d869a2665
Nov 13 17:40:48 user nova-compute[75100]: INFO nova.virt.block_device [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Attempting to driver detach volume 5870cd8c-a5eb-4ef8-92fc-337d869a2665 from mountpoint /dev/vdb
Nov 13 17:40:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Attempting to detach device vdb from instance f589271c-7e6c-4352-8b85-8a7aca61dc7f from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:40:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:40:48 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:40:48 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 13 17:40:48 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:40:48 user nova-compute[75100]:   <serial>5870cd8c-a5eb-4ef8-92fc-337d869a2665</serial>
Nov 13 17:40:48 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:40:48 user nova-compute[75100]: </disk>
Nov 13 17:40:48 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:40:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Successfully detached device vdb from instance f589271c-7e6c-4352-8b85-8a7aca61dc7f from the persistent domain config.
Nov 13 17:40:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f589271c-7e6c-4352-8b85-8a7aca61dc7f from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:40:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:40:48 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:40:48 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 13 17:40:48 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:40:48 user nova-compute[75100]:   <serial>5870cd8c-a5eb-4ef8-92fc-337d869a2665</serial>
Nov 13 17:40:48 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:40:48 user nova-compute[75100]: </disk>
Nov 13 17:40:48 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:40:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f589271c-7e6c-4352-8b85-8a7aca61dc7f {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:40:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:52 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:40:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 17:40:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:40:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "009a667b-e7aa-480e-8b81-76001a1434f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "009a667b-e7aa-480e-8b81-76001a1434f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:05 user nova-compute[75100]: INFO nova.compute.manager [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Terminating instance
Nov 13 17:41:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-64251ea0-e78d-450d-8697-153fbe199f45 req-2fe70a02-c126-407f-9ca9-7e1f74c28864 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Received event network-vif-unplugged-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64251ea0-e78d-450d-8697-153fbe199f45 req-2fe70a02-c126-407f-9ca9-7e1f74c28864 service nova] Acquiring lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64251ea0-e78d-450d-8697-153fbe199f45 req-2fe70a02-c126-407f-9ca9-7e1f74c28864 service nova] Lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64251ea0-e78d-450d-8697-153fbe199f45 req-2fe70a02-c126-407f-9ca9-7e1f74c28864 service nova] Lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-64251ea0-e78d-450d-8697-153fbe199f45 req-2fe70a02-c126-407f-9ca9-7e1f74c28864 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] No waiting events found dispatching network-vif-unplugged-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-64251ea0-e78d-450d-8697-153fbe199f45 req-2fe70a02-c126-407f-9ca9-7e1f74c28864 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Received event network-vif-unplugged-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-1d58322c-e835-4d91-a17b-49c1038b6dbb req-e0537a73-5a89-4573-8530-d3af115c0a10 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-changed-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.compute.manager [req-1d58322c-e835-4d91-a17b-49c1038b6dbb req-e0537a73-5a89-4573-8530-d3af115c0a10 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Refreshing instance network info cache due to event network-changed-bde2a813-7715-4fc1-a99e-f3cc8484988b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1d58322c-e835-4d91-a17b-49c1038b6dbb req-e0537a73-5a89-4573-8530-d3af115c0a10 service nova] Acquiring lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1d58322c-e835-4d91-a17b-49c1038b6dbb req-e0537a73-5a89-4573-8530-d3af115c0a10 service nova] Acquired lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.network.neutron [req-1d58322c-e835-4d91-a17b-49c1038b6dbb req-e0537a73-5a89-4573-8530-d3af115c0a10 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Refreshing network info cache for port bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:41:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Instance destroyed successfully.
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lazy-loading 'resources' on Instance uuid 009a667b-e7aa-480e-8b81-76001a1434f9 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:39:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-13813907',display_name='tempest-ServersNegativeTestJSON-server-13813907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-13813907',id=40,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:39:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='047cedafb8344129a644233034fef4f4',ramdisk_id='',reservation_id='r-a5uz1obp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1990231420',owner_user_name='tempest-ServersNegativeTestJSON-1990231420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:39:25Z,user_data=None,user_id='380d78e868b44598aa311630ce34e0d1',uuid=009a667b-e7aa-480e-8b81-76001a1434f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "address": "fa:16:3e:41:15:14", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a7cc98-67", "ovs_interfaceid": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Converting VIF {"id": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "address": "fa:16:3e:41:15:14", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9a7cc98-67", "ovs_interfaceid": "a9a7cc98-677e-4f6f-b60b-cd4b7fbac585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:15:14,bridge_name='br-int',has_traffic_filtering=True,id=a9a7cc98-677e-4f6f-b60b-cd4b7fbac585,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a7cc98-67') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG os_vif [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:15:14,bridge_name='br-int',has_traffic_filtering=True,id=a9a7cc98-677e-4f6f-b60b-cd4b7fbac585,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a7cc98-67') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9a7cc98-67, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e346e4b-2b53-484e-b127-a6d8f5446300) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:06 user nova-compute[75100]: INFO os_vif [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:15:14,bridge_name='br-int',has_traffic_filtering=True,id=a9a7cc98-677e-4f6f-b60b-cd4b7fbac585,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9a7cc98-67')
Nov 13 17:41:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Deleting instance files /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9_del
Nov 13 17:41:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Deletion of /opt/stack/data/nova/instances/009a667b-e7aa-480e-8b81-76001a1434f9_del complete
Nov 13 17:41:06 user nova-compute[75100]: INFO nova.compute.manager [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 17:41:06 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.network.neutron [req-1d58322c-e835-4d91-a17b-49c1038b6dbb req-e0537a73-5a89-4573-8530-d3af115c0a10 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updated VIF entry in instance network info cache for port bde2a813-7715-4fc1-a99e-f3cc8484988b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG nova.network.neutron [req-1d58322c-e835-4d91-a17b-49c1038b6dbb req-e0537a73-5a89-4573-8530-d3af115c0a10 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updating instance_info_cache with network_info: [{"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1d58322c-e835-4d91-a17b-49c1038b6dbb req-e0537a73-5a89-4573-8530-d3af115c0a10 service nova] Releasing lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:41:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:07 user nova-compute[75100]: INFO nova.compute.manager [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Detaching volume ee2be01c-6462-4d98-b582-f21609370f4f
Nov 13 17:41:07 user nova-compute[75100]: INFO nova.virt.block_device [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Attempting to driver detach volume ee2be01c-6462-4d98-b582-f21609370f4f from mountpoint /dev/vdb
Nov 13 17:41:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Attempting to detach device vdb from instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:41:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:41:07 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:41:07 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:41:07 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:41:07 user nova-compute[75100]:   <serial>ee2be01c-6462-4d98-b582-f21609370f4f</serial>
Nov 13 17:41:07 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:41:07 user nova-compute[75100]: </disk>
Nov 13 17:41:07 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:41:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Successfully detached device vdb from instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 from the persistent domain config.
Nov 13 17:41:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:41:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:41:07 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:41:07 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:41:07 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:41:07 user nova-compute[75100]:   <serial>ee2be01c-6462-4d98-b582-f21609370f4f</serial>
Nov 13 17:41:07 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:41:07 user nova-compute[75100]: </disk>
Nov 13 17:41:07 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:41:07 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:07 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Took 0.53 seconds to deallocate network for instance.
Nov 13 17:41:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:07 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:41:07 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:41:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:07 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Deleted allocations for instance 009a667b-e7aa-480e-8b81-76001a1434f9
Nov 13 17:41:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:41:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1f275b7c-65e2-47f3-9ecf-f6d6ca613cde tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "009a667b-e7aa-480e-8b81-76001a1434f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.867s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Received event network-vif-plugged-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] Acquiring lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] Lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] Lock "009a667b-e7aa-480e-8b81-76001a1434f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] No waiting events found dispatching network-vif-plugged-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:41:08 user nova-compute[75100]: WARNING nova.compute.manager [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Received unexpected event network-vif-plugged-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 for instance with vm_state deleted and task_state None.
Nov 13 17:41:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-changed-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Refreshing instance network info cache due to event network-changed-bde2a813-7715-4fc1-a99e-f3cc8484988b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] Acquiring lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] Acquired lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG nova.network.neutron [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Refreshing network info cache for port bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-a12fa30b-fb26-4cf3-b964-8d975bb4329b req-ecbc272e-a59c-4cf6-9c2e-d4e5527226a6 service nova] [instance: 009a667b-e7aa-480e-8b81-76001a1434f9] Received event network-vif-deleted-a9a7cc98-677e-4f6f-b60b-cd4b7fbac585 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG nova.network.neutron [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updated VIF entry in instance network info cache for port bde2a813-7715-4fc1-a99e-f3cc8484988b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG nova.network.neutron [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updating instance_info_cache with network_info: [{"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8f4e75b9-8240-4a92-b009-ec16be7e30c9 req-7806b950-33d4-4fbd-b6ef-897610243b26 service nova] Releasing lock "refresh_cache-6c6dba6f-fa48-4d7f-a529-d0215f251fc2" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:41:09 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f589271c-7e6c-4352-8b85-8a7aca61dc7f is timed out.
Nov 13 17:41:09 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Successfully detached device vdb from instance f589271c-7e6c-4352-8b85-8a7aca61dc7f from the live domain config.
Nov 13 17:41:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJmHVSAD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:41:09 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[367b6711-889e-4fff-a6a8-1ab8414c5c48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:41:09 user nova-compute[75100]: No targets found.
Nov 13 17:41:09 user nova-compute[75100]: iSNS:
Nov 13 17:41:09 user nova-compute[75100]: No targets found.
Nov 13 17:41:09 user nova-compute[75100]: STATIC:
Nov 13 17:41:09 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665
Nov 13 17:41:09 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:41:09 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:41:09 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f
Nov 13 17:41:09 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:41:09 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:41:09 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5
Nov 13 17:41:09 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:41:09 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:41:09 user nova-compute[75100]: FIRMWARE:
Nov 13 17:41:09 user nova-compute[75100]: No targets found.
Nov 13 17:41:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:41:09 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:41:09 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4981ba80-cb84-4708-a12c-27af98fbcbfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace5fe5a-023d-4584-b4be-825c7a013a9b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:41:09 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)
Nov 13 17:41:09 user nova-compute[75100]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 (non-flash)
Nov 13 17:41:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:41:09 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)
Nov 13 17:41:09 user nova-compute[75100]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 (non-flash)
Nov 13 17:41:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38e4f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d74696-31b1-419a-b0b3-7f59559b1dfc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c88545-10e9-4b91-981e-431dcba9d9ce]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6bccf7-43f5-4176-8be4-a07c83687887]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c2b3e2-51c7-47e8-b425-7886880799c8]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f174b048-e700-48c9-b3ad-8d8597429beb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd6b9ee-3839-429e-a145-2cd65ea28be7]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665, portal: 172.16.0.220,3260]
Nov 13 17:41:09 user nova-compute[75100]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665, portal: 172.16.0.220,3260] successful.
Nov 13 17:41:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5870cd8c-a5eb-4ef8-92fc-337d869a2665 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ea9f1e-462f-4d63-a193-d140f60663a3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] <== disconnect_volume: return (333ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:41:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:41:10 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lazy-loading 'flavor' on Instance uuid f589271c-7e6c-4352-8b85-8a7aca61dc7f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:41:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d9169b53-3753-444b-a3ba-263981c8b3c2 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.618s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-b391235c-9a30-4cb4-ac26-3c6d1904036a req-3d97e155-e05b-45df-a027-d3fe2251065d service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Received event network-changed-71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-b391235c-9a30-4cb4-ac26-3c6d1904036a req-3d97e155-e05b-45df-a027-d3fe2251065d service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Refreshing instance network info cache due to event network-changed-71e2d08e-c462-47aa-be0d-22e5d53b7d2b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:41:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b391235c-9a30-4cb4-ac26-3c6d1904036a req-3d97e155-e05b-45df-a027-d3fe2251065d service nova] Acquiring lock "refresh_cache-9b73aa60-0376-4499-8dd8-90db5f5d544b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:41:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b391235c-9a30-4cb4-ac26-3c6d1904036a req-3d97e155-e05b-45df-a027-d3fe2251065d service nova] Acquired lock "refresh_cache-9b73aa60-0376-4499-8dd8-90db5f5d544b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:41:13 user nova-compute[75100]: DEBUG nova.network.neutron [req-b391235c-9a30-4cb4-ac26-3c6d1904036a req-3d97e155-e05b-45df-a027-d3fe2251065d service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Refreshing network info cache for port 71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "9b73aa60-0376-4499-8dd8-90db5f5d544b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-b391235c-9a30-4cb4-ac26-3c6d1904036a req-3d97e155-e05b-45df-a027-d3fe2251065d service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Updated VIF entry in instance network info cache for port 71e2d08e-c462-47aa-be0d-22e5d53b7d2b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG nova.network.neutron [req-b391235c-9a30-4cb4-ac26-3c6d1904036a req-3d97e155-e05b-45df-a027-d3fe2251065d service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Updating instance_info_cache with network_info: [{"id": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "address": "fa:16:3e:32:a1:31", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e2d08e-c4", "ovs_interfaceid": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:14 user nova-compute[75100]: INFO nova.compute.manager [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Terminating instance
Nov 13 17:41:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b391235c-9a30-4cb4-ac26-3c6d1904036a req-3d97e155-e05b-45df-a027-d3fe2251065d service nova] Releasing lock "refresh_cache-9b73aa60-0376-4499-8dd8-90db5f5d544b" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Instance destroyed successfully.
Nov 13 17:41:14 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'resources' on Instance uuid 9b73aa60-0376-4499-8dd8-90db5f5d544b {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-316497331',display_name='tempest-AttachVolumeNegativeTest-server-316497331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-316497331',id=41,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxTI/M0remiJjw0epgGH9ZoBikABFhkfbrsalsGMi7T5MVDAvn9pcFLt2d3YesLobdD9sS/+TicRZ5AW2wYuJHUQFavKDftSmiOeUV9aMdZd49Cy0w7lYcAWPWMb4Khkg==',key_name='tempest-keypair-1039454101',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:39:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6352bffe5fa144f996e2ba07f69f4ee4',ramdisk_id='',reservation_id='r-c86eftky',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2126330685',owner_user_name='tempest-AttachVolumeNegativeTest-2126330685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fde156049464deba4b3a3125712baa9',uuid=9b73aa60-0376-4499-8dd8-90db5f5d544b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "address": "fa:16:3e:32:a1:31", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e2d08e-c4", "ovs_interfaceid": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converting VIF {"id": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "address": "fa:16:3e:32:a1:31", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71e2d08e-c4", "ovs_interfaceid": "71e2d08e-c462-47aa-be0d-22e5d53b7d2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:a1:31,bridge_name='br-int',has_traffic_filtering=True,id=71e2d08e-c462-47aa-be0d-22e5d53b7d2b,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e2d08e-c4') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG os_vif [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:a1:31,bridge_name='br-int',has_traffic_filtering=True,id=71e2d08e-c462-47aa-be0d-22e5d53b7d2b,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e2d08e-c4') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-2dee009f-1219-4809-8d9e-9aef2b15f046 req-2b532bad-683f-4928-b848-aa678840e32c service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Received event network-vif-unplugged-71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2dee009f-1219-4809-8d9e-9aef2b15f046 req-2b532bad-683f-4928-b848-aa678840e32c service nova] Acquiring lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2dee009f-1219-4809-8d9e-9aef2b15f046 req-2b532bad-683f-4928-b848-aa678840e32c service nova] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2dee009f-1219-4809-8d9e-9aef2b15f046 req-2b532bad-683f-4928-b848-aa678840e32c service nova] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-2dee009f-1219-4809-8d9e-9aef2b15f046 req-2b532bad-683f-4928-b848-aa678840e32c service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] No waiting events found dispatching network-vif-unplugged-71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG nova.compute.manager [req-2dee009f-1219-4809-8d9e-9aef2b15f046 req-2b532bad-683f-4928-b848-aa678840e32c service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Received event network-vif-unplugged-71e2d08e-c462-47aa-be0d-22e5d53b7d2b for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71e2d08e-c4, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04735d29-0f2b-4ef9-8aa6-ad3a2dd93986) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:14 user nova-compute[75100]: INFO os_vif [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:a1:31,bridge_name='br-int',has_traffic_filtering=True,id=71e2d08e-c462-47aa-be0d-22e5d53b7d2b,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71e2d08e-c4')
Nov 13 17:41:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Deleting instance files /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b_del
Nov 13 17:41:14 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Deletion of /opt/stack/data/nova/instances/9b73aa60-0376-4499-8dd8-90db5f5d544b_del complete
Nov 13 17:41:14 user nova-compute[75100]: INFO nova.compute.manager [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 13 17:41:14 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:41:14 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:41:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-c735c2bc-23af-47e6-b83a-f58ba0334096 req-ecc42773-a684-431d-9838-fcd2369c785f service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-changed-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:15 user nova-compute[75100]: DEBUG nova.compute.manager [req-c735c2bc-23af-47e6-b83a-f58ba0334096 req-ecc42773-a684-431d-9838-fcd2369c785f service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Refreshing instance network info cache due to event network-changed-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:41:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c735c2bc-23af-47e6-b83a-f58ba0334096 req-ecc42773-a684-431d-9838-fcd2369c785f service nova] Acquiring lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:41:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c735c2bc-23af-47e6-b83a-f58ba0334096 req-ecc42773-a684-431d-9838-fcd2369c785f service nova] Acquired lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:41:15 user nova-compute[75100]: DEBUG nova.network.neutron [req-c735c2bc-23af-47e6-b83a-f58ba0334096 req-ecc42773-a684-431d-9838-fcd2369c785f service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Refreshing network info cache for port 8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:16 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Took 1.41 seconds to deallocate network for instance.
Nov 13 17:41:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-7456788d-e2d9-4dcb-98f5-fd2147a75998 req-e8480d89-64f0-48aa-8256-414573d28fe3 service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Received event network-vif-deleted-71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-c735c2bc-23af-47e6-b83a-f58ba0334096 req-ecc42773-a684-431d-9838-fcd2369c785f service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updated VIF entry in instance network info cache for port 8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-c735c2bc-23af-47e6-b83a-f58ba0334096 req-ecc42773-a684-431d-9838-fcd2369c785f service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updating instance_info_cache with network_info: [{"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c735c2bc-23af-47e6-b83a-f58ba0334096 req-ecc42773-a684-431d-9838-fcd2369c785f service nova] Releasing lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:16 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Deleted allocations for instance 9b73aa60-0376-4499-8dd8-90db5f5d544b
Nov 13 17:41:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92e5d0f-612a-4391-9336-cc27f896a44e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.511s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-07950a88-8e86-4486-9216-d616104b070d req-79367bee-17ce-4747-8182-acfec9b00593 service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Received event network-vif-plugged-71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-07950a88-8e86-4486-9216-d616104b070d req-79367bee-17ce-4747-8182-acfec9b00593 service nova] Acquiring lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-07950a88-8e86-4486-9216-d616104b070d req-79367bee-17ce-4747-8182-acfec9b00593 service nova] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-07950a88-8e86-4486-9216-d616104b070d req-79367bee-17ce-4747-8182-acfec9b00593 service nova] Lock "9b73aa60-0376-4499-8dd8-90db5f5d544b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-07950a88-8e86-4486-9216-d616104b070d req-79367bee-17ce-4747-8182-acfec9b00593 service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] No waiting events found dispatching network-vif-plugged-71e2d08e-c462-47aa-be0d-22e5d53b7d2b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:41:16 user nova-compute[75100]: WARNING nova.compute.manager [req-07950a88-8e86-4486-9216-d616104b070d req-79367bee-17ce-4747-8182-acfec9b00593 service nova] [instance: 9b73aa60-0376-4499-8dd8-90db5f5d544b] Received unexpected event network-vif-plugged-71e2d08e-c462-47aa-be0d-22e5d53b7d2b for instance with vm_state deleted and task_state None.
Nov 13 17:41:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:18 user nova-compute[75100]: INFO nova.compute.manager [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Shelving
Nov 13 17:41:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-4d95595f-2545-476d-bebb-d325fbf4297f req-25d0d39e-5a34-4859-b5d6-7ade9a4042c6 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-vif-unplugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4d95595f-2545-476d-bebb-d325fbf4297f req-25d0d39e-5a34-4859-b5d6-7ade9a4042c6 service nova] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4d95595f-2545-476d-bebb-d325fbf4297f req-25d0d39e-5a34-4859-b5d6-7ade9a4042c6 service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4d95595f-2545-476d-bebb-d325fbf4297f req-25d0d39e-5a34-4859-b5d6-7ade9a4042c6 service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-4d95595f-2545-476d-bebb-d325fbf4297f req-25d0d39e-5a34-4859-b5d6-7ade9a4042c6 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] No waiting events found dispatching network-vif-unplugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:41:18 user nova-compute[75100]: WARNING nova.compute.manager [req-4d95595f-2545-476d-bebb-d325fbf4297f req-25d0d39e-5a34-4859-b5d6-7ade9a4042c6 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received unexpected event network-vif-unplugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac for instance with vm_state active and task_state shelving.
Nov 13 17:41:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Instance destroyed successfully.
Nov 13 17:41:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Beginning cold snapshot process
Nov 13 17:41:19 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:41:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk /opt/stack/data/nova/instances/snapshots/tmp5u987kk5/3c70126a279149cc9d0330de08faeeea {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:20 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk /opt/stack/data/nova/instances/snapshots/tmp5u987kk5/3c70126a279149cc9d0330de08faeeea" returned: 0 in 0.546s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:20 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Snapshot extracted, beginning image upload
Nov 13 17:41:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-dd0d99e5-7649-4d99-be80-a0ff6c8b01da req-744f790b-02a3-496a-8e9e-e747201d5f76 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-dd0d99e5-7649-4d99-be80-a0ff6c8b01da req-744f790b-02a3-496a-8e9e-e747201d5f76 service nova] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-dd0d99e5-7649-4d99-be80-a0ff6c8b01da req-744f790b-02a3-496a-8e9e-e747201d5f76 service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-dd0d99e5-7649-4d99-be80-a0ff6c8b01da req-744f790b-02a3-496a-8e9e-e747201d5f76 service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-dd0d99e5-7649-4d99-be80-a0ff6c8b01da req-744f790b-02a3-496a-8e9e-e747201d5f76 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] No waiting events found dispatching network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:41:20 user nova-compute[75100]: WARNING nova.compute.manager [req-dd0d99e5-7649-4d99-be80-a0ff6c8b01da req-744f790b-02a3-496a-8e9e-e747201d5f76 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received unexpected event network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac for instance with vm_state active and task_state shelving_image_uploading.
Nov 13 17:41:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Snapshot image upload complete
Nov 13 17:41:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:41:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:22 user nova-compute[75100]: INFO nova.compute.manager [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Shelve offloading
Nov 13 17:41:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Instance destroyed successfully.
Nov 13 17:41:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:41:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:41:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquired lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:41:22 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updating instance_info_cache with network_info: [{"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Releasing lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Instance destroyed successfully.
Nov 13 17:41:23 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'resources' on Instance uuid 6a32f8b7-2e32-42a7-b600-fc88bcc577fd {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2002205144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2002205144',id=42,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw5/1O+7fCYlXt2eQaRgEJLZ4+j1NCpqqWKg3tOzqMfKiv6ItQM1MSBVha+jLGvqqFyBNuibAfc5etB/s5ejgZZQK5kstmOid0WnRHZWrwqF2GYhsMRpGVp8JeJfpfkZQ==',key_name='tempest-keypair-457334197',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='db67a12bfc7f48b380175a6871012f25',ramdisk_id='',reservation_id='r-senzr9dj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1414200693',owner_user_name='tempest-AttachVolumeShelveTestJSON-1414200693-project-member',shelved_at='2023-11-13T17:41:22.772859',shelved_host='user',shelved_image_id='ac4ad627-9a84-4f9c-bf3f-c15a7aef4751'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54440f660c64141ad91285ddef65ca9',uuid=6a32f8b7-2e32-42a7-b600-fc88bcc577fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converting VIF {"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG os_vif [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fbe0d9f-51, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-6f69c91e-6959-4206-b394-add768bc828b req-160cd454-5091-4f15-aaf4-f508852d8c9e service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-changed-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-6f69c91e-6959-4206-b394-add768bc828b req-160cd454-5091-4f15-aaf4-f508852d8c9e service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Refreshing instance network info cache due to event network-changed-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6f69c91e-6959-4206-b394-add768bc828b req-160cd454-5091-4f15-aaf4-f508852d8c9e service nova] Acquiring lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6f69c91e-6959-4206-b394-add768bc828b req-160cd454-5091-4f15-aaf4-f508852d8c9e service nova] Acquired lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-6f69c91e-6959-4206-b394-add768bc828b req-160cd454-5091-4f15-aaf4-f508852d8c9e service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Refreshing network info cache for port 8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddd4e5b8-06f8-435e-9a6e-a757ad1f0c5f) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:23 user nova-compute[75100]: INFO os_vif [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51')
Nov 13 17:41:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Deleting instance files /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd_del
Nov 13 17:41:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Deletion of /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd_del complete
Nov 13 17:41:24 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Deleted allocations for instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd
Nov 13 17:41:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a32f8b7-2e32-42a7-b600-fc88bcc577fd {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:41:24 user nova-compute[75100]: DEBUG nova.objects.base [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Object Instance<6a32f8b7-2e32-42a7-b600-fc88bcc577fd> lazy-loaded attributes: resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:41:24 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:41:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:41:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ffeeead0-6056-4865-93e4-4cb27aac77c5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.833s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-6f69c91e-6959-4206-b394-add768bc828b req-160cd454-5091-4f15-aaf4-f508852d8c9e service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updated VIF entry in instance network info cache for port 8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:41:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-6f69c91e-6959-4206-b394-add768bc828b req-160cd454-5091-4f15-aaf4-f508852d8c9e service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updating instance_info_cache with network_info: [{"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6f69c91e-6959-4206-b394-add768bc828b req-160cd454-5091-4f15-aaf4-f508852d8c9e service nova] Releasing lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:41:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:27 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 is timed out.
Nov 13 17:41:27 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Successfully detached device vdb from instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 from the live domain config.
Nov 13 17:41:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MASpkilB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:41:27 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[13df117f-1e82-4e3c-b3de-212d57674c45]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:41:27 user nova-compute[75100]: No targets found.
Nov 13 17:41:27 user nova-compute[75100]: iSNS:
Nov 13 17:41:27 user nova-compute[75100]: No targets found.
Nov 13 17:41:27 user nova-compute[75100]: STATIC:
Nov 13 17:41:27 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f
Nov 13 17:41:27 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:41:27 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:41:27 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5
Nov 13 17:41:27 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:41:27 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:41:27 user nova-compute[75100]: FIRMWARE:
Nov 13 17:41:27 user nova-compute[75100]: No targets found.
Nov 13 17:41:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:41:27 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:41:27 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50f29ab-402d-4658-bac6-74bd27c2c6f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0cbe6d-ea20-4135-9ff9-a75a1c16e9d6]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:41:27 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)
Nov 13 17:41:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f (non-flash)
Nov 13 17:41:27 user nova-compute[75100]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)
Nov 13 17:41:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38d42290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d24db9d-8ddf-4f82-9bab-7e7b7ea6d9c9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5d8e67-c425-4384-bc60-24495f5e6aac]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea40f7c-bf0f-4318-8739-c508588fd62b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c130b0-6705-4e09-8e16-356f7746e901]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:41:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[830035c8-f1ce-476d-bc88-95bc9dfcf272]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[590f0e51-b989-4a46-b3b3-e420d13304da]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f, portal: 172.16.0.220,3260]
Nov 13 17:41:28 user nova-compute[75100]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f, portal: 172.16.0.220,3260] successful.
Nov 13 17:41:28 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee2be01c-6462-4d98-b582-f21609370f4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[75aee57b-5226-4438-b92a-27b127791d3c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] <== disconnect_volume: return (296ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'flavor' on Instance uuid 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:41:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f5c5951f-c503-49ab-9d8d-1362f4f70513 tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:41:32 user nova-compute[75100]: INFO nova.compute.claims [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Claim successful on node user
Nov 13 17:41:32 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:41:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:41:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG nova.policy [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71dd4a1af0fb40cabbcaaa6766a3d760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fed1cab4b1646748950eeb97bae09e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:41:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Creating image(s)
Nov 13 17:41:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "/opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "/opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "/opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk 1073741824" returned: 0 in 0.078s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Cannot resize image /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Ensure instance console log exists: /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Successfully created port: 60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:41:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Successfully updated port: 60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "refresh_cache-6415b849-7cef-4ea4-83f8-ccc5fb2d052f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquired lock "refresh_cache-6415b849-7cef-4ea4-83f8-ccc5fb2d052f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-4a232183-e550-4bae-918e-4f309e5e1322 req-7e2e901a-bbd9-4d39-a108-b4b23ce77b01 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Received event network-changed-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-4a232183-e550-4bae-918e-4f309e5e1322 req-7e2e901a-bbd9-4d39-a108-b4b23ce77b01 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Refreshing instance network info cache due to event network-changed-60a7b68d-60a8-4c5b-9d87-976a7cea4af4. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4a232183-e550-4bae-918e-4f309e5e1322 req-7e2e901a-bbd9-4d39-a108-b4b23ce77b01 service nova] Acquiring lock "refresh_cache-6415b849-7cef-4ea4-83f8-ccc5fb2d052f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Updating instance_info_cache with network_info: [{"id": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "address": "fa:16:3e:1b:44:2f", "network": {"id": "914537bd-569c-44e7-a4ff-7c01056ae14f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425334271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fed1cab4b1646748950eeb97bae09e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60a7b68d-60", "ovs_interfaceid": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Releasing lock "refresh_cache-6415b849-7cef-4ea4-83f8-ccc5fb2d052f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Instance network_info: |[{"id": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "address": "fa:16:3e:1b:44:2f", "network": {"id": "914537bd-569c-44e7-a4ff-7c01056ae14f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425334271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fed1cab4b1646748950eeb97bae09e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60a7b68d-60", "ovs_interfaceid": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4a232183-e550-4bae-918e-4f309e5e1322 req-7e2e901a-bbd9-4d39-a108-b4b23ce77b01 service nova] Acquired lock "refresh_cache-6415b849-7cef-4ea4-83f8-ccc5fb2d052f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-4a232183-e550-4bae-918e-4f309e5e1322 req-7e2e901a-bbd9-4d39-a108-b4b23ce77b01 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Refreshing network info cache for port 60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Start _get_guest_xml network_info=[{"id": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "address": "fa:16:3e:1b:44:2f", "network": {"id": "914537bd-569c-44e7-a4ff-7c01056ae14f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425334271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fed1cab4b1646748950eeb97bae09e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60a7b68d-60", "ovs_interfaceid": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:41:34 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:41:34 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1173730006',display_name='tempest-TestServerVolumeAttachmentScenario-server-1173730006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1173730006',id=43,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFu8tV6Jpigo6zBzeKhfQQPPhvLnNpdPi4pYwxX4NJD10apNyDHcKvA+3FtOcHinfPJw/d1yg+U9/NZaDlKQ7of4JHgyxEXFcVQdmAggzGLEy1+dziwo2kyzjUpEGbftiw==',key_name='tempest-keypair-1703532500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fed1cab4b1646748950eeb97bae09e3',ramdisk_id='',reservation_id='r-0fd537zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1234263029',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1234263029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71dd4a1af0fb40cabbcaaa6766a3d760',uuid=6415b849-7cef-4ea4-83f8-ccc5fb2d052f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "address": "fa:16:3e:1b:44:2f", "network": {"id": "914537bd-569c-44e7-a4ff-7c01056ae14f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425334271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fed1cab4b1646748950eeb97bae09e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60a7b68d-60", "ovs_interfaceid": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Converting VIF {"id": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "address": "fa:16:3e:1b:44:2f", "network": {"id": "914537bd-569c-44e7-a4ff-7c01056ae14f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425334271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fed1cab4b1646748950eeb97bae09e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60a7b68d-60", "ovs_interfaceid": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:44:2f,bridge_name='br-int',has_traffic_filtering=True,id=60a7b68d-60a8-4c5b-9d87-976a7cea4af4,network=Network(914537bd-569c-44e7-a4ff-7c01056ae14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60a7b68d-60') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lazy-loading 'pci_devices' on Instance uuid 6415b849-7cef-4ea4-83f8-ccc5fb2d052f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:41:34 user nova-compute[75100]:   <uuid>6415b849-7cef-4ea4-83f8-ccc5fb2d052f</uuid>
Nov 13 17:41:34 user nova-compute[75100]:   <name>instance-0000002b</name>
Nov 13 17:41:34 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:41:34 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:41:34 user nova-compute[75100]:   <metadata>
Nov 13 17:41:34 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:41:34 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:41:34 user nova-compute[75100]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1173730006</nova:name>
Nov 13 17:41:34 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:41:34</nova:creationTime>
Nov 13 17:41:34 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:41:34 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:41:34 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:41:34 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:41:34 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:41:34 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:41:34 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:41:34 user nova-compute[75100]:       <nova:owner>
Nov 13 17:41:34 user nova-compute[75100]:         <nova:user uuid="71dd4a1af0fb40cabbcaaa6766a3d760">tempest-TestServerVolumeAttachmentScenario-1234263029-project-member</nova:user>
Nov 13 17:41:34 user nova-compute[75100]:         <nova:project uuid="6fed1cab4b1646748950eeb97bae09e3">tempest-TestServerVolumeAttachmentScenario-1234263029</nova:project>
Nov 13 17:41:34 user nova-compute[75100]:       </nova:owner>
Nov 13 17:41:34 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:41:34 user nova-compute[75100]:       <nova:ports>
Nov 13 17:41:34 user nova-compute[75100]:         <nova:port uuid="60a7b68d-60a8-4c5b-9d87-976a7cea4af4">
Nov 13 17:41:34 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 17:41:34 user nova-compute[75100]:         </nova:port>
Nov 13 17:41:34 user nova-compute[75100]:       </nova:ports>
Nov 13 17:41:34 user nova-compute[75100]:     </nova:instance>
Nov 13 17:41:34 user nova-compute[75100]:   </metadata>
Nov 13 17:41:34 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:41:34 user nova-compute[75100]:     <system>
Nov 13 17:41:34 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:41:34 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:41:34 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:41:34 user nova-compute[75100]:       <entry name="serial">6415b849-7cef-4ea4-83f8-ccc5fb2d052f</entry>
Nov 13 17:41:34 user nova-compute[75100]:       <entry name="uuid">6415b849-7cef-4ea4-83f8-ccc5fb2d052f</entry>
Nov 13 17:41:34 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:41:34 user nova-compute[75100]:     </system>
Nov 13 17:41:34 user nova-compute[75100]:   </sysinfo>
Nov 13 17:41:34 user nova-compute[75100]:   <os>
Nov 13 17:41:34 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:41:34 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:41:34 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:41:34 user nova-compute[75100]:   </os>
Nov 13 17:41:34 user nova-compute[75100]:   <features>
Nov 13 17:41:34 user nova-compute[75100]:     <acpi/>
Nov 13 17:41:34 user nova-compute[75100]:     <apic/>
Nov 13 17:41:34 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:41:34 user nova-compute[75100]:   </features>
Nov 13 17:41:34 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:41:34 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:41:34 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:41:34 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:41:34 user nova-compute[75100]:   </clock>
Nov 13 17:41:34 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:41:34 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:41:34 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:41:34 user nova-compute[75100]:   </cpu>
Nov 13 17:41:34 user nova-compute[75100]:   <devices>
Nov 13 17:41:34 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:41:34 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:41:34 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk"/>
Nov 13 17:41:34 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:41:34 user nova-compute[75100]:     </disk>
Nov 13 17:41:34 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:41:34 user nova-compute[75100]:       <mac address="fa:16:3e:1b:44:2f"/>
Nov 13 17:41:34 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:41:34 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:41:34 user nova-compute[75100]:       <target dev="tap60a7b68d-60"/>
Nov 13 17:41:34 user nova-compute[75100]:     </interface>
Nov 13 17:41:34 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:41:34 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/console.log" append="off"/>
Nov 13 17:41:34 user nova-compute[75100]:     </serial>
Nov 13 17:41:34 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:41:34 user nova-compute[75100]:     <video>
Nov 13 17:41:34 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:41:34 user nova-compute[75100]:     </video>
Nov 13 17:41:34 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:41:34 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:41:34 user nova-compute[75100]:     </rng>
Nov 13 17:41:34 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:41:34 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:41:34 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:41:34 user nova-compute[75100]:     </memballoon>
Nov 13 17:41:34 user nova-compute[75100]:   </devices>
Nov 13 17:41:34 user nova-compute[75100]: </domain>
Nov 13 17:41:34 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1173730006',display_name='tempest-TestServerVolumeAttachmentScenario-server-1173730006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1173730006',id=43,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFu8tV6Jpigo6zBzeKhfQQPPhvLnNpdPi4pYwxX4NJD10apNyDHcKvA+3FtOcHinfPJw/d1yg+U9/NZaDlKQ7of4JHgyxEXFcVQdmAggzGLEy1+dziwo2kyzjUpEGbftiw==',key_name='tempest-keypair-1703532500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fed1cab4b1646748950eeb97bae09e3',ramdisk_id='',reservation_id='r-0fd537zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1234263029',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1234263029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:41:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71dd4a1af0fb40cabbcaaa6766a3d760',uuid=6415b849-7cef-4ea4-83f8-ccc5fb2d052f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "address": "fa:16:3e:1b:44:2f", "network": {"id": "914537bd-569c-44e7-a4ff-7c01056ae14f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425334271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fed1cab4b1646748950eeb97bae09e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60a7b68d-60", "ovs_interfaceid": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Converting VIF {"id": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "address": "fa:16:3e:1b:44:2f", "network": {"id": "914537bd-569c-44e7-a4ff-7c01056ae14f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425334271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fed1cab4b1646748950eeb97bae09e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60a7b68d-60", "ovs_interfaceid": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:44:2f,bridge_name='br-int',has_traffic_filtering=True,id=60a7b68d-60a8-4c5b-9d87-976a7cea4af4,network=Network(914537bd-569c-44e7-a4ff-7c01056ae14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60a7b68d-60') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG os_vif [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:44:2f,bridge_name='br-int',has_traffic_filtering=True,id=60a7b68d-60a8-4c5b-9d87-976a7cea4af4,network=Network(914537bd-569c-44e7-a4ff-7c01056ae14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60a7b68d-60') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e86313e4-b96c-5790-8a4b-ecc30c5e7176', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60a7b68d-60, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60a7b68d-60, col_values=(('qos', UUID('e9feded4-dc67-4901-8f37-e4464d6d9ef2')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60a7b68d-60, col_values=(('external_ids', {'iface-id': '60a7b68d-60a8-4c5b-9d87-976a7cea4af4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:44:2f', 'vm-uuid': '6415b849-7cef-4ea4-83f8-ccc5fb2d052f'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:34 user nova-compute[75100]: INFO os_vif [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:44:2f,bridge_name='br-int',has_traffic_filtering=True,id=60a7b68d-60a8-4c5b-9d87-976a7cea4af4,network=Network(914537bd-569c-44e7-a4ff-7c01056ae14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60a7b68d-60')
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] No VIF found with MAC fa:16:3e:1b:44:2f, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-4a232183-e550-4bae-918e-4f309e5e1322 req-7e2e901a-bbd9-4d39-a108-b4b23ce77b01 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Updated VIF entry in instance network info cache for port 60a7b68d-60a8-4c5b-9d87-976a7cea4af4. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-4a232183-e550-4bae-918e-4f309e5e1322 req-7e2e901a-bbd9-4d39-a108-b4b23ce77b01 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Updating instance_info_cache with network_info: [{"id": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "address": "fa:16:3e:1b:44:2f", "network": {"id": "914537bd-569c-44e7-a4ff-7c01056ae14f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425334271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fed1cab4b1646748950eeb97bae09e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60a7b68d-60", "ovs_interfaceid": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4a232183-e550-4bae-918e-4f309e5e1322 req-7e2e901a-bbd9-4d39-a108-b4b23ce77b01 service nova] Releasing lock "refresh_cache-6415b849-7cef-4ea4-83f8-ccc5fb2d052f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:41:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-ce18e4bb-6175-4dc6-9751-157b853099bc req-655fdf91-8bbe-459e-be03-32fa06c2f6fd service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Received event network-vif-plugged-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ce18e4bb-6175-4dc6-9751-157b853099bc req-655fdf91-8bbe-459e-be03-32fa06c2f6fd service nova] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ce18e4bb-6175-4dc6-9751-157b853099bc req-655fdf91-8bbe-459e-be03-32fa06c2f6fd service nova] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ce18e4bb-6175-4dc6-9751-157b853099bc req-655fdf91-8bbe-459e-be03-32fa06c2f6fd service nova] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-ce18e4bb-6175-4dc6-9751-157b853099bc req-655fdf91-8bbe-459e-be03-32fa06c2f6fd service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] No waiting events found dispatching network-vif-plugged-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:41:36 user nova-compute[75100]: WARNING nova.compute.manager [req-ce18e4bb-6175-4dc6-9751-157b853099bc req-655fdf91-8bbe-459e-be03-32fa06c2f6fd service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Received unexpected event network-vif-plugged-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 for instance with vm_state building and task_state spawning.
Nov 13 17:41:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:41:38 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Instance spawned successfully.
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-fdf909b9-9588-4a6b-b562-d2b92cf0c3c3 req-5fc832b3-46f8-4c3d-a853-8db1a36ffe78 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Received event network-vif-plugged-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fdf909b9-9588-4a6b-b562-d2b92cf0c3c3 req-5fc832b3-46f8-4c3d-a853-8db1a36ffe78 service nova] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fdf909b9-9588-4a6b-b562-d2b92cf0c3c3 req-5fc832b3-46f8-4c3d-a853-8db1a36ffe78 service nova] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-fdf909b9-9588-4a6b-b562-d2b92cf0c3c3 req-5fc832b3-46f8-4c3d-a853-8db1a36ffe78 service nova] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-fdf909b9-9588-4a6b-b562-d2b92cf0c3c3 req-5fc832b3-46f8-4c3d-a853-8db1a36ffe78 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] No waiting events found dispatching network-vif-plugged-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:41:38 user nova-compute[75100]: WARNING nova.compute.manager [req-fdf909b9-9588-4a6b-b562-d2b92cf0c3c3 req-5fc832b3-46f8-4c3d-a853-8db1a36ffe78 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Received unexpected event network-vif-plugged-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 for instance with vm_state building and task_state spawning.
Nov 13 17:41:38 user nova-compute[75100]: INFO nova.compute.manager [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:41:38 user nova-compute[75100]: INFO nova.compute.manager [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Took 6.16 seconds to build instance.
Nov 13 17:41:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a9a91524-88c8-4c3b-8528-30673466bf36 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.261s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-81c970a1-23fd-4cda-a532-a40811e85e11" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-81c970a1-23fd-4cda-a532-a40811e85e11" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Updating instance_info_cache with network_info: [{"id": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "address": "fa:16:3e:74:57:cb", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18412885-d3", "ovs_interfaceid": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-81c970a1-23fd-4cda-a532-a40811e85e11" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:41:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:41:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:41:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:39 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:41:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:41:41 user nova-compute[75100]: INFO nova.compute.manager [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] instance snapshotting
Nov 13 17:41:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Beginning live snapshot process
Nov 13 17:41:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:41:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json -f qcow2" returned: 0 in 0.509s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json -f qcow2 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:41:41 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:41:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8430MB free_disk=25.094314575195312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:41:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 81c970a1-23fd-4cda-a532-a40811e85e11 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f0bf103e-23eb-486a-a5df-9f3e66d4d076 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f589271c-7e6c-4352-8b85-8a7aca61dc7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.188s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpme7tgdgf/94f1b1896c484ce6b36ca629c5358642.delta 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpme7tgdgf/94f1b1896c484ce6b36ca629c5358642.delta 1073741824" returned: 0 in 0.055s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 17:41:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:41:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75100) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 17:41:43 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 17:41:43 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:41:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpme7tgdgf/94f1b1896c484ce6b36ca629c5358642.delta /opt/stack/data/nova/instances/snapshots/tmpme7tgdgf/94f1b1896c484ce6b36ca629c5358642 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpme7tgdgf/94f1b1896c484ce6b36ca629c5358642.delta /opt/stack/data/nova/instances/snapshots/tmpme7tgdgf/94f1b1896c484ce6b36ca629c5358642" returned: 0 in 0.325s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Snapshot extracted, beginning image upload
Nov 13 17:41:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:41:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:41:46 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Snapshot image upload complete
Nov 13 17:41:46 user nova-compute[75100]: INFO nova.compute.manager [None req-3f5f1a6a-0d43-435a-9162-590ef1523eee tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Took 5.39 seconds to snapshot the instance on the hypervisor.
Nov 13 17:41:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:41:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:48 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:41:48 user nova-compute[75100]: INFO nova.compute.claims [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Claim successful on node user
Nov 13 17:41:49 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:41:49 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:41:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:41:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:41:49 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:41:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:41:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:41:49 user nova-compute[75100]: DEBUG nova.policy [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc9396967a5f4666b8d1d4df794b31aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'beeb8e861865462e80ed3a213a09f8b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:41:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:41:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:41:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Creating image(s)
Nov 13 17:41:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "/opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "/opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "e5a596f820172de77e6bbb4fcd0a1e9231b09073" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "e5a596f820172de77e6bbb4fcd0a1e9231b09073" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Successfully created port: b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:41:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:41:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:50 user nova-compute[75100]: DEBUG nova.virt.images [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] ac7d6b50-1493-409a-8855-0c836288086d was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 17:41:50 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:41:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073.part /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073.part /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073.converted" returned: 0 in 0.483s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Successfully updated port: b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-92433116-113f-4f09-ab2d-44784358c695 req-cf66fdd2-7742-4a7b-970a-87535aee54dc service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-changed-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-92433116-113f-4f09-ab2d-44784358c695 req-cf66fdd2-7742-4a7b-970a-87535aee54dc service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Refreshing instance network info cache due to event network-changed-b367db30-a5c0-4b4b-b655-d9288eb2be67. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92433116-113f-4f09-ab2d-44784358c695 req-cf66fdd2-7742-4a7b-970a-87535aee54dc service nova] Acquiring lock "refresh_cache-ce4d18fc-5cf8-4916-97be-a1943a6ddd34" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92433116-113f-4f09-ab2d-44784358c695 req-cf66fdd2-7742-4a7b-970a-87535aee54dc service nova] Acquired lock "refresh_cache-ce4d18fc-5cf8-4916-97be-a1943a6ddd34" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-92433116-113f-4f09-ab2d-44784358c695 req-cf66fdd2-7742-4a7b-970a-87535aee54dc service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Refreshing network info cache for port b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073.converted --force-share --output=json" returned: 0 in 0.231s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "e5a596f820172de77e6bbb4fcd0a1e9231b09073" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.794s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "refresh_cache-ce4d18fc-5cf8-4916-97be-a1943a6ddd34" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-92433116-113f-4f09-ab2d-44784358c695 req-cf66fdd2-7742-4a7b-970a-87535aee54dc service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073 --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "e5a596f820172de77e6bbb4fcd0a1e9231b09073" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "e5a596f820172de77e6bbb4fcd0a1e9231b09073" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-92433116-113f-4f09-ab2d-44784358c695 req-cf66fdd2-7742-4a7b-970a-87535aee54dc service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-92433116-113f-4f09-ab2d-44784358c695 req-cf66fdd2-7742-4a7b-970a-87535aee54dc service nova] Releasing lock "refresh_cache-ce4d18fc-5cf8-4916-97be-a1943a6ddd34" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquired lock "refresh_cache-ce4d18fc-5cf8-4916-97be-a1943a6ddd34" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073 --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073,backing_fmt=raw /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073,backing_fmt=raw /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk 1073741824" returned: 0 in 0.052s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "e5a596f820172de77e6bbb4fcd0a1e9231b09073" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Updating instance_info_cache with network_info: [{"id": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "address": "fa:16:3e:9f:a3:4c", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb367db30-a5", "ovs_interfaceid": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073 --force-share --output=json" returned: 0 in 0.220s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Ensure instance console log exists: /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Releasing lock "refresh_cache-ce4d18fc-5cf8-4916-97be-a1943a6ddd34" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Instance network_info: |[{"id": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "address": "fa:16:3e:9f:a3:4c", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb367db30-a5", "ovs_interfaceid": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Start _get_guest_xml network_info=[{"id": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "address": "fa:16:3e:9f:a3:4c", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb367db30-a5", "ovs_interfaceid": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ab365d01a42aae9b629ec744292d0ae6',container_format='bare',created_at=2023-11-13T17:41:41Z,direct_url=<?>,disk_format='qcow2',id=ac7d6b50-1493-409a-8855-0c836288086d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-845520082',owner='beeb8e861865462e80ed3a213a09f8b1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T17:41:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'ac7d6b50-1493-409a-8855-0c836288086d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:41:51 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:41:51 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ab365d01a42aae9b629ec744292d0ae6',container_format='bare',created_at=2023-11-13T17:41:41Z,direct_url=<?>,disk_format='qcow2',id=ac7d6b50-1493-409a-8855-0c836288086d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-845520082',owner='beeb8e861865462e80ed3a213a09f8b1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T17:41:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1770230999',display_name='tempest-TestStampPattern-server-1770230999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1770230999',id=44,image_ref='ac7d6b50-1493-409a-8855-0c836288086d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrOJF+I3W+VJrAHWGtN2MBJOMvEMODLQzn5ApWc/HW7iPWY+6/PHmwlDqsSJlNM55EzzJ9KtnrIwnuukCA4w5GI3FhgGrJxENswyXMhu8EweYbo1/3V9R/qP3i6bwmSqA==',key_name='tempest-TestStampPattern-1218817336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beeb8e861865462e80ed3a213a09f8b1',ramdisk_id='',reservation_id='r-7gvy571h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f589271c-7e6c-4352-8b85-8a7aca61dc7f',image_min_disk='1',image_min_ram='0',image_owner_id='beeb8e861865462e80ed3a213a09f8b1',image_owner_project_name='tempest-TestStampPattern-317206420',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-317206420-project-member',image_user_id='bc9396967a5f4666b8d1d4df794b31aa',network_allocated='True',owner_project_name='tempest-TestStampPattern-317206420',owner_user_name='tempest-TestStampPattern-317206420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:41:49Z,user_data=None,user_id='bc9396967a5f4666b8d1d4df794b31aa',uuid=ce4d18fc-5cf8-4916-97be-a1943a6ddd34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "address": "fa:16:3e:9f:a3:4c", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb367db30-a5", "ovs_interfaceid": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Converting VIF {"id": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "address": "fa:16:3e:9f:a3:4c", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb367db30-a5", "ovs_interfaceid": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=b367db30-a5c0-4b4b-b655-d9288eb2be67,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb367db30-a5') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lazy-loading 'pci_devices' on Instance uuid ce4d18fc-5cf8-4916-97be-a1943a6ddd34 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:41:51 user nova-compute[75100]:   <uuid>ce4d18fc-5cf8-4916-97be-a1943a6ddd34</uuid>
Nov 13 17:41:51 user nova-compute[75100]:   <name>instance-0000002c</name>
Nov 13 17:41:51 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:41:51 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:41:51 user nova-compute[75100]:   <metadata>
Nov 13 17:41:51 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:41:51 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:41:51 user nova-compute[75100]:       <nova:name>tempest-TestStampPattern-server-1770230999</nova:name>
Nov 13 17:41:51 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:41:51</nova:creationTime>
Nov 13 17:41:51 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:41:51 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:41:51 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:41:51 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:41:51 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:41:51 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:41:51 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:41:51 user nova-compute[75100]:       <nova:owner>
Nov 13 17:41:51 user nova-compute[75100]:         <nova:user uuid="bc9396967a5f4666b8d1d4df794b31aa">tempest-TestStampPattern-317206420-project-member</nova:user>
Nov 13 17:41:51 user nova-compute[75100]:         <nova:project uuid="beeb8e861865462e80ed3a213a09f8b1">tempest-TestStampPattern-317206420</nova:project>
Nov 13 17:41:51 user nova-compute[75100]:       </nova:owner>
Nov 13 17:41:51 user nova-compute[75100]:       <nova:root type="image" uuid="ac7d6b50-1493-409a-8855-0c836288086d"/>
Nov 13 17:41:51 user nova-compute[75100]:       <nova:ports>
Nov 13 17:41:51 user nova-compute[75100]:         <nova:port uuid="b367db30-a5c0-4b4b-b655-d9288eb2be67">
Nov 13 17:41:51 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 17:41:51 user nova-compute[75100]:         </nova:port>
Nov 13 17:41:51 user nova-compute[75100]:       </nova:ports>
Nov 13 17:41:51 user nova-compute[75100]:     </nova:instance>
Nov 13 17:41:51 user nova-compute[75100]:   </metadata>
Nov 13 17:41:51 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:41:51 user nova-compute[75100]:     <system>
Nov 13 17:41:51 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:41:51 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:41:51 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:41:51 user nova-compute[75100]:       <entry name="serial">ce4d18fc-5cf8-4916-97be-a1943a6ddd34</entry>
Nov 13 17:41:51 user nova-compute[75100]:       <entry name="uuid">ce4d18fc-5cf8-4916-97be-a1943a6ddd34</entry>
Nov 13 17:41:51 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:41:51 user nova-compute[75100]:     </system>
Nov 13 17:41:51 user nova-compute[75100]:   </sysinfo>
Nov 13 17:41:51 user nova-compute[75100]:   <os>
Nov 13 17:41:51 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:41:51 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:41:51 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:41:51 user nova-compute[75100]:   </os>
Nov 13 17:41:51 user nova-compute[75100]:   <features>
Nov 13 17:41:51 user nova-compute[75100]:     <acpi/>
Nov 13 17:41:51 user nova-compute[75100]:     <apic/>
Nov 13 17:41:51 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:41:51 user nova-compute[75100]:   </features>
Nov 13 17:41:51 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:41:51 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:41:51 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:41:51 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:41:51 user nova-compute[75100]:   </clock>
Nov 13 17:41:51 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:41:51 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:41:51 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:41:51 user nova-compute[75100]:   </cpu>
Nov 13 17:41:51 user nova-compute[75100]:   <devices>
Nov 13 17:41:51 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:41:51 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:41:51 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk"/>
Nov 13 17:41:51 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:41:51 user nova-compute[75100]:     </disk>
Nov 13 17:41:51 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:41:51 user nova-compute[75100]:       <mac address="fa:16:3e:9f:a3:4c"/>
Nov 13 17:41:51 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:41:51 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:41:51 user nova-compute[75100]:       <target dev="tapb367db30-a5"/>
Nov 13 17:41:51 user nova-compute[75100]:     </interface>
Nov 13 17:41:51 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:41:51 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/console.log" append="off"/>
Nov 13 17:41:51 user nova-compute[75100]:     </serial>
Nov 13 17:41:51 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:41:51 user nova-compute[75100]:     <video>
Nov 13 17:41:51 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:41:51 user nova-compute[75100]:     </video>
Nov 13 17:41:51 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:41:51 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:41:51 user nova-compute[75100]:     </rng>
Nov 13 17:41:51 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:41:51 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:41:51 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:41:51 user nova-compute[75100]:     </memballoon>
Nov 13 17:41:51 user nova-compute[75100]:   </devices>
Nov 13 17:41:51 user nova-compute[75100]: </domain>
Nov 13 17:41:51 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1770230999',display_name='tempest-TestStampPattern-server-1770230999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1770230999',id=44,image_ref='ac7d6b50-1493-409a-8855-0c836288086d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrOJF+I3W+VJrAHWGtN2MBJOMvEMODLQzn5ApWc/HW7iPWY+6/PHmwlDqsSJlNM55EzzJ9KtnrIwnuukCA4w5GI3FhgGrJxENswyXMhu8EweYbo1/3V9R/qP3i6bwmSqA==',key_name='tempest-TestStampPattern-1218817336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='beeb8e861865462e80ed3a213a09f8b1',ramdisk_id='',reservation_id='r-7gvy571h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f589271c-7e6c-4352-8b85-8a7aca61dc7f',image_min_disk='1',image_min_ram='0',image_owner_id='beeb8e861865462e80ed3a213a09f8b1',image_owner_project_name='tempest-TestStampPattern-317206420',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-317206420-project-member',image_user_id='bc9396967a5f4666b8d1d4df794b31aa',network_allocated='True',owner_project_name='tempest-TestStampPattern-317206420',owner_user_name='tempest-TestStampPattern-317206420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:41:49Z,user_data=None,user_id='bc9396967a5f4666b8d1d4df794b31aa',uuid=ce4d18fc-5cf8-4916-97be-a1943a6ddd34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "address": "fa:16:3e:9f:a3:4c", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb367db30-a5", "ovs_interfaceid": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Converting VIF {"id": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "address": "fa:16:3e:9f:a3:4c", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb367db30-a5", "ovs_interfaceid": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=b367db30-a5c0-4b4b-b655-d9288eb2be67,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb367db30-a5') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG os_vif [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=b367db30-a5c0-4b4b-b655-d9288eb2be67,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb367db30-a5') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f3cf530-5a48-592c-87f9-cbe232f7e187', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb367db30-a5, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb367db30-a5, col_values=(('qos', UUID('4198b115-3373-429d-ab71-03aa82042e0a')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb367db30-a5, col_values=(('external_ids', {'iface-id': 'b367db30-a5c0-4b4b-b655-d9288eb2be67', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:a3:4c', 'vm-uuid': 'ce4d18fc-5cf8-4916-97be-a1943a6ddd34'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:41:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:52 user nova-compute[75100]: INFO os_vif [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=b367db30-a5c0-4b4b-b655-d9288eb2be67,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb367db30-a5')
Nov 13 17:41:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:41:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] No VIF found with MAC fa:16:3e:9f:a3:4c, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:41:52 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:41:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-c5aaf373-08c2-4fd3-a834-3309df69df2c req-edc61ef2-e268-4959-a9e1-43533afe02b5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c5aaf373-08c2-4fd3-a834-3309df69df2c req-edc61ef2-e268-4959-a9e1-43533afe02b5 service nova] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c5aaf373-08c2-4fd3-a834-3309df69df2c req-edc61ef2-e268-4959-a9e1-43533afe02b5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c5aaf373-08c2-4fd3-a834-3309df69df2c req-edc61ef2-e268-4959-a9e1-43533afe02b5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-c5aaf373-08c2-4fd3-a834-3309df69df2c req-edc61ef2-e268-4959-a9e1-43533afe02b5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] No waiting events found dispatching network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:41:53 user nova-compute[75100]: WARNING nova.compute.manager [req-c5aaf373-08c2-4fd3-a834-3309df69df2c req-edc61ef2-e268-4959-a9e1-43533afe02b5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received unexpected event network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 for instance with vm_state building and task_state spawning.
Nov 13 17:41:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:41:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:41:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Instance spawned successfully.
Nov 13 17:41:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:41:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:41:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:41:55 user nova-compute[75100]: INFO nova.compute.manager [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 13 17:41:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:41:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-96e94005-dc40-4b1d-b92d-cee140306837 req-5de128cd-ef20-43fd-8229-0692fff328cc service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-96e94005-dc40-4b1d-b92d-cee140306837 req-5de128cd-ef20-43fd-8229-0692fff328cc service nova] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-96e94005-dc40-4b1d-b92d-cee140306837 req-5de128cd-ef20-43fd-8229-0692fff328cc service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-96e94005-dc40-4b1d-b92d-cee140306837 req-5de128cd-ef20-43fd-8229-0692fff328cc service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-96e94005-dc40-4b1d-b92d-cee140306837 req-5de128cd-ef20-43fd-8229-0692fff328cc service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] No waiting events found dispatching network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:41:55 user nova-compute[75100]: WARNING nova.compute.manager [req-96e94005-dc40-4b1d-b92d-cee140306837 req-5de128cd-ef20-43fd-8229-0692fff328cc service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received unexpected event network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 for instance with vm_state building and task_state spawning.
Nov 13 17:41:55 user nova-compute[75100]: INFO nova.compute.manager [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Took 6.82 seconds to build instance.
Nov 13 17:41:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6b46c0f2-94b5-4a94-a88a-7ef6b0dedc91 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.934s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:58 user nova-compute[75100]: INFO nova.compute.manager [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Terminating instance
Nov 13 17:41:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:41:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-7e119571-b63b-46db-acb9-eb931fa0f4dc req-e2e002a8-3027-40cd-99b9-0a48d921e189 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-vif-unplugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7e119571-b63b-46db-acb9-eb931fa0f4dc req-e2e002a8-3027-40cd-99b9-0a48d921e189 service nova] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7e119571-b63b-46db-acb9-eb931fa0f4dc req-e2e002a8-3027-40cd-99b9-0a48d921e189 service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7e119571-b63b-46db-acb9-eb931fa0f4dc req-e2e002a8-3027-40cd-99b9-0a48d921e189 service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-7e119571-b63b-46db-acb9-eb931fa0f4dc req-e2e002a8-3027-40cd-99b9-0a48d921e189 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] No waiting events found dispatching network-vif-unplugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG nova.compute.manager [req-7e119571-b63b-46db-acb9-eb931fa0f4dc req-e2e002a8-3027-40cd-99b9-0a48d921e189 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-vif-unplugged-bde2a813-7715-4fc1-a99e-f3cc8484988b for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Instance destroyed successfully.
Nov 13 17:41:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lazy-loading 'resources' on Instance uuid 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:37:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-271909253',display_name='tempest-TestMinimumBasicScenario-server-271909253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-271909253',id=36,image_ref='a5e8ded8-4c58-4f04-aeea-b6e9452780d1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/jb2gAq4MPFGLmeCSDS7e2R6FXMvVNiV2zxrLc46Ggp78cgynx93QfCXmvNb38jvNvbInYQwlwoBXg3gXv0yoVr1YOUrhIS0tHT/r2eWJO3p9j9SA4XHdo6+7SPcSXaQ==',key_name='tempest-TestMinimumBasicScenario-863798775',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:37:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dca12c426d0c495b80b77b8ae26be4eb',ramdisk_id='',reservation_id='r-4scowcic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a5e8ded8-4c58-4f04-aeea-b6e9452780d1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1769966982',owner_user_name='tempest-TestMinimumBasicScenario-1769966982-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:39:24Z,user_data=None,user_id='2ba71ec67c664e94a71cc9f9107303a5',uuid=6c6dba6f-fa48-4d7f-a529-d0215f251fc2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converting VIF {"id": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "address": "fa:16:3e:84:df:da", "network": {"id": "c9e173d8-8313-4677-b4ab-b556f1c40f2b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1187759899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dca12c426d0c495b80b77b8ae26be4eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbde2a813-77", "ovs_interfaceid": "bde2a813-7715-4fc1-a99e-f3cc8484988b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:df:da,bridge_name='br-int',has_traffic_filtering=True,id=bde2a813-7715-4fc1-a99e-f3cc8484988b,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde2a813-77') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG os_vif [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:df:da,bridge_name='br-int',has_traffic_filtering=True,id=bde2a813-7715-4fc1-a99e-f3cc8484988b,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde2a813-77') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbde2a813-77, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d88e1c81-2272-41e6-bc7d-c14224cadf99) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:41:59 user nova-compute[75100]: INFO os_vif [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:df:da,bridge_name='br-int',has_traffic_filtering=True,id=bde2a813-7715-4fc1-a99e-f3cc8484988b,network=Network(c9e173d8-8313-4677-b4ab-b556f1c40f2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbde2a813-77')
Nov 13 17:41:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Deleting instance files /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2_del
Nov 13 17:41:59 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Deletion of /opt/stack/data/nova/instances/6c6dba6f-fa48-4d7f-a529-d0215f251fc2_del complete
Nov 13 17:41:59 user nova-compute[75100]: INFO nova.compute.manager [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 13 17:41:59 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:41:59 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:42:00 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Took 0.44 seconds to deallocate network for instance.
Nov 13 17:42:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-35606b7f-59e5-4ac1-bb0b-4f0b0aad6138 req-95277fe1-ddcb-4558-b604-9519024283a7 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-vif-deleted-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:42:00 user nova-compute[75100]: INFO nova.compute.manager [req-35606b7f-59e5-4ac1-bb0b-4f0b0aad6138 req-95277fe1-ddcb-4558-b604-9519024283a7 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Neutron deleted interface bde2a813-7715-4fc1-a99e-f3cc8484988b; detaching it from the instance and deleting it from the info cache
Nov 13 17:42:00 user nova-compute[75100]: DEBUG nova.network.neutron [req-35606b7f-59e5-4ac1-bb0b-4f0b0aad6138 req-95277fe1-ddcb-4558-b604-9519024283a7 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG nova.compute.manager [req-35606b7f-59e5-4ac1-bb0b-4f0b0aad6138 req-95277fe1-ddcb-4558-b604-9519024283a7 service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Detach interface failed, port_id=bde2a813-7715-4fc1-a99e-f3cc8484988b, reason: Instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:42:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:42:00 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Deleted allocations for instance 6c6dba6f-fa48-4d7f-a529-d0215f251fc2
Nov 13 17:42:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-fb8cfcdf-a64b-4979-9773-c3216b39d19a tempest-TestMinimumBasicScenario-1769966982 tempest-TestMinimumBasicScenario-1769966982-project-member] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.827s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:42:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-5a560d1a-28dd-4433-8e3d-66b71e49bf9e req-da39b062-99ff-44d7-88d2-c361da34e8ee service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:42:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5a560d1a-28dd-4433-8e3d-66b71e49bf9e req-da39b062-99ff-44d7-88d2-c361da34e8ee service nova] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:42:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5a560d1a-28dd-4433-8e3d-66b71e49bf9e req-da39b062-99ff-44d7-88d2-c361da34e8ee service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:42:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5a560d1a-28dd-4433-8e3d-66b71e49bf9e req-da39b062-99ff-44d7-88d2-c361da34e8ee service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:42:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-5a560d1a-28dd-4433-8e3d-66b71e49bf9e req-da39b062-99ff-44d7-88d2-c361da34e8ee service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] No waiting events found dispatching network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:42:01 user nova-compute[75100]: WARNING nova.compute.manager [req-5a560d1a-28dd-4433-8e3d-66b71e49bf9e req-da39b062-99ff-44d7-88d2-c361da34e8ee service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received unexpected event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b for instance with vm_state deleted and task_state None.
Nov 13 17:42:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-5a560d1a-28dd-4433-8e3d-66b71e49bf9e req-da39b062-99ff-44d7-88d2-c361da34e8ee service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:42:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5a560d1a-28dd-4433-8e3d-66b71e49bf9e req-da39b062-99ff-44d7-88d2-c361da34e8ee service nova] Acquiring lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:42:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5a560d1a-28dd-4433-8e3d-66b71e49bf9e req-da39b062-99ff-44d7-88d2-c361da34e8ee service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:42:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5a560d1a-28dd-4433-8e3d-66b71e49bf9e req-da39b062-99ff-44d7-88d2-c361da34e8ee service nova] Lock "6c6dba6f-fa48-4d7f-a529-d0215f251fc2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:42:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-5a560d1a-28dd-4433-8e3d-66b71e49bf9e req-da39b062-99ff-44d7-88d2-c361da34e8ee service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] No waiting events found dispatching network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:42:01 user nova-compute[75100]: WARNING nova.compute.manager [req-5a560d1a-28dd-4433-8e3d-66b71e49bf9e req-da39b062-99ff-44d7-88d2-c361da34e8ee service nova] [instance: 6c6dba6f-fa48-4d7f-a529-d0215f251fc2] Received unexpected event network-vif-plugged-bde2a813-7715-4fc1-a99e-f3cc8484988b for instance with vm_state deleted and task_state None.
Nov 13 17:42:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "81c970a1-23fd-4cda-a532-a40811e85e11" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:42:06 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "81c970a1-23fd-4cda-a532-a40811e85e11" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:42:06 user nova-compute[75100]: INFO nova.compute.manager [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Detaching volume 8f440fa3-bcca-432e-b587-8654e24fccf5
Nov 13 17:42:06 user nova-compute[75100]: INFO nova.virt.block_device [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Attempting to driver detach volume 8f440fa3-bcca-432e-b587-8654e24fccf5 from mountpoint /dev/vdb
Nov 13 17:42:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Attempting to detach device vdb from instance 81c970a1-23fd-4cda-a532-a40811e85e11 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:42:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:42:06 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:42:06 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 13 17:42:06 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:42:06 user nova-compute[75100]:   <serial>8f440fa3-bcca-432e-b587-8654e24fccf5</serial>
Nov 13 17:42:06 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:42:06 user nova-compute[75100]: </disk>
Nov 13 17:42:06 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:42:06 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully detached device vdb from instance 81c970a1-23fd-4cda-a532-a40811e85e11 from the persistent domain config.
Nov 13 17:42:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81c970a1-23fd-4cda-a532-a40811e85e11 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:42:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:42:06 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:42:06 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 13 17:42:06 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:42:06 user nova-compute[75100]:   <serial>8f440fa3-bcca-432e-b587-8654e24fccf5</serial>
Nov 13 17:42:06 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:42:06 user nova-compute[75100]: </disk>
Nov 13 17:42:06 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:42:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81c970a1-23fd-4cda-a532-a40811e85e11 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:42:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:26 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 81c970a1-23fd-4cda-a532-a40811e85e11 is timed out.
Nov 13 17:42:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully detached device vdb from instance 81c970a1-23fd-4cda-a532-a40811e85e11 from the live domain config.
Nov 13 17:42:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUhMLPYe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:42:26 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1967eb26-bb2c-4553-ba31-595081cb64e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:42:26 user nova-compute[75100]: No targets found.
Nov 13 17:42:26 user nova-compute[75100]: iSNS:
Nov 13 17:42:26 user nova-compute[75100]: No targets found.
Nov 13 17:42:26 user nova-compute[75100]: STATIC:
Nov 13 17:42:26 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5
Nov 13 17:42:26 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:42:26 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:42:26 user nova-compute[75100]: FIRMWARE:
Nov 13 17:42:26 user nova-compute[75100]: No targets found.
Nov 13 17:42:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:42:26 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:42:26 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2cf0b2-4752-4bca-b680-be993772e689]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e6db6d-c059-4d7d-9b88-f11b9af7bed2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)
Nov 13 17:42:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 (non-flash)
Nov 13 17:42:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c2727a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea4548b-9509-4310-bc40-71cdcac77c11]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0027eba8-7158-40df-8f7b-b67d547a50d8]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df5bc38-f318-4858-80e3-1d51232b3d21]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[860e8344-1b09-4dcc-a4b2-bc1a5e240978]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3361893-4ddd-476d-9847-56c4b2089066]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d3e4b7-b2d6-4936-8d3c-247a52363b68]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5, portal: 172.16.0.220,3260]
Nov 13 17:42:26 user nova-compute[75100]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5, portal: 172.16.0.220,3260] successful.
Nov 13 17:42:26 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f440fa3-bcca-432e-b587-8654e24fccf5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[519eb42a-adac-47be-99b4-275f3073c64f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] <== disconnect_volume: return (303ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:42:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:42:27 user nova-compute[75100]: DEBUG nova.objects.instance [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'flavor' on Instance uuid 81c970a1-23fd-4cda-a532-a40811e85e11 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:42:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-68c8b312-1de9-4f57-885b-732639b9f4ac tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "81c970a1-23fd-4cda-a532-a40811e85e11" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.689s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:42:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:42:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:42:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:42:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:42:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:42:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:42:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-f0bf103e-23eb-486a-a5df-9f3e66d4d076" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-f0bf103e-23eb-486a-a5df-9f3e66d4d076" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Updating instance_info_cache with network_info: [{"id": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "address": "fa:16:3e:e1:f3:58", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5bea88-fe", "ovs_interfaceid": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-f0bf103e-23eb-486a-a5df-9f3e66d4d076" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:42:39 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:42:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:42:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:42:42 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:42:42 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:42:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8339MB free_disk=24.947975158691406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 81c970a1-23fd-4cda-a532-a40811e85e11 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f0bf103e-23eb-486a-a5df-9f3e66d4d076 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f589271c-7e6c-4352-8b85-8a7aca61dc7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ce4d18fc-5cf8-4916-97be-a1943a6ddd34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:42:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.323s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:42:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:42:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:42:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:42:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:42:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "81c970a1-23fd-4cda-a532-a40811e85e11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "81c970a1-23fd-4cda-a532-a40811e85e11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:42:56 user nova-compute[75100]: INFO nova.compute.manager [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Terminating instance
Nov 13 17:42:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-167e8ec7-6faf-4a22-aafa-0c8ec3e28203 req-5eb64c02-a922-4be0-9608-381e5943b8cd service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Received event network-vif-unplugged-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-167e8ec7-6faf-4a22-aafa-0c8ec3e28203 req-5eb64c02-a922-4be0-9608-381e5943b8cd service nova] Acquiring lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-167e8ec7-6faf-4a22-aafa-0c8ec3e28203 req-5eb64c02-a922-4be0-9608-381e5943b8cd service nova] Lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-167e8ec7-6faf-4a22-aafa-0c8ec3e28203 req-5eb64c02-a922-4be0-9608-381e5943b8cd service nova] Lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-167e8ec7-6faf-4a22-aafa-0c8ec3e28203 req-5eb64c02-a922-4be0-9608-381e5943b8cd service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] No waiting events found dispatching network-vif-unplugged-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:42:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-167e8ec7-6faf-4a22-aafa-0c8ec3e28203 req-5eb64c02-a922-4be0-9608-381e5943b8cd service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Received event network-vif-unplugged-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:42:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Instance destroyed successfully.
Nov 13 17:42:57 user nova-compute[75100]: DEBUG nova.objects.instance [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'resources' on Instance uuid 81c970a1-23fd-4cda-a532-a40811e85e11 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:37:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2006715285',display_name='tempest-AttachVolumeNegativeTest-server-2006715285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2006715285',id=37,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8gdeudjlRJt3GXF7/cRQLF1T6EAdTmZ5zmtPxD4NfmB/EF4igNsTcb475rMcjuKI7OqPdcI7xszWYmIrTrLZ7UcRrZr2qhDH5wHy1AgK12t3IxKhhqwACIq4q8H73vCw==',key_name='tempest-keypair-750520521',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:37:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6352bffe5fa144f996e2ba07f69f4ee4',ramdisk_id='',reservation_id='r-3opii07q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2126330685',owner_user_name='tempest-AttachVolumeNegativeTest-2126330685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:37:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fde156049464deba4b3a3125712baa9',uuid=81c970a1-23fd-4cda-a532-a40811e85e11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "address": "fa:16:3e:74:57:cb", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18412885-d3", "ovs_interfaceid": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converting VIF {"id": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "address": "fa:16:3e:74:57:cb", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18412885-d3", "ovs_interfaceid": "18412885-d3aa-422d-a8f7-eb1c96b1f0c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:57:cb,bridge_name='br-int',has_traffic_filtering=True,id=18412885-d3aa-422d-a8f7-eb1c96b1f0c8,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18412885-d3') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG os_vif [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:57:cb,bridge_name='br-int',has_traffic_filtering=True,id=18412885-d3aa-422d-a8f7-eb1c96b1f0c8,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18412885-d3') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18412885-d3, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2fb7641-8ed4-41a5-a0a0-a6de1737d81c) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:42:57 user nova-compute[75100]: INFO os_vif [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:57:cb,bridge_name='br-int',has_traffic_filtering=True,id=18412885-d3aa-422d-a8f7-eb1c96b1f0c8,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18412885-d3')
Nov 13 17:42:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Deleting instance files /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11_del
Nov 13 17:42:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Deletion of /opt/stack/data/nova/instances/81c970a1-23fd-4cda-a532-a40811e85e11_del complete
Nov 13 17:42:57 user nova-compute[75100]: INFO nova.compute.manager [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 17:42:57 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:42:57 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:42:58 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:42:58 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Took 0.94 seconds to deallocate network for instance.
Nov 13 17:42:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-36bc7738-79dd-42ca-a125-e0070455d193 req-34f96446-6d9f-4978-b213-665e5b68ffda service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Received event network-vif-deleted-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:42:58 user nova-compute[75100]: INFO nova.compute.manager [req-36bc7738-79dd-42ca-a125-e0070455d193 req-34f96446-6d9f-4978-b213-665e5b68ffda service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Neutron deleted interface 18412885-d3aa-422d-a8f7-eb1c96b1f0c8; detaching it from the instance and deleting it from the info cache
Nov 13 17:42:58 user nova-compute[75100]: DEBUG nova.network.neutron [req-36bc7738-79dd-42ca-a125-e0070455d193 req-34f96446-6d9f-4978-b213-665e5b68ffda service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:42:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-36bc7738-79dd-42ca-a125-e0070455d193 req-34f96446-6d9f-4978-b213-665e5b68ffda service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Detach interface failed, port_id=18412885-d3aa-422d-a8f7-eb1c96b1f0c8, reason: Instance 81c970a1-23fd-4cda-a532-a40811e85e11 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:42:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:42:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:42:58 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:42:58 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:42:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:42:58 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Deleted allocations for instance 81c970a1-23fd-4cda-a532-a40811e85e11
Nov 13 17:42:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-23cfabe2-a470-48e3-b908-682fdbec3725 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "81c970a1-23fd-4cda-a532-a40811e85e11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.240s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:42:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-448f38e3-7e6a-49a4-8c48-15c34d21eeac req-4eea91f0-af6c-4f55-a118-74517f02b9c3 service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Received event network-vif-plugged-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:42:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-448f38e3-7e6a-49a4-8c48-15c34d21eeac req-4eea91f0-af6c-4f55-a118-74517f02b9c3 service nova] Acquiring lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:42:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-448f38e3-7e6a-49a4-8c48-15c34d21eeac req-4eea91f0-af6c-4f55-a118-74517f02b9c3 service nova] Lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:42:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-448f38e3-7e6a-49a4-8c48-15c34d21eeac req-4eea91f0-af6c-4f55-a118-74517f02b9c3 service nova] Lock "81c970a1-23fd-4cda-a532-a40811e85e11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:42:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-448f38e3-7e6a-49a4-8c48-15c34d21eeac req-4eea91f0-af6c-4f55-a118-74517f02b9c3 service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] No waiting events found dispatching network-vif-plugged-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:42:58 user nova-compute[75100]: WARNING nova.compute.manager [req-448f38e3-7e6a-49a4-8c48-15c34d21eeac req-4eea91f0-af6c-4f55-a118-74517f02b9c3 service nova] [instance: 81c970a1-23fd-4cda-a532-a40811e85e11] Received unexpected event network-vif-plugged-18412885-d3aa-422d-a8f7-eb1c96b1f0c8 for instance with vm_state deleted and task_state None.
Nov 13 17:43:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:11 user nova-compute[75100]: INFO nova.compute.manager [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Unshelving
Nov 13 17:43:11 user nova-compute[75100]: INFO nova.virt.block_device [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Booting with volume c4206aad-359c-4f8d-9dfd-8da263a4fc16 at /dev/vdc
Nov 13 17:43:11 user nova-compute[75100]: DEBUG os_brick.utils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[714a7359-8004-41c0-8ad8-b06369e149ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb22741-583a-4c90-acd1-4dccc7a7118f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcef496-522e-467d-9d95-08e560a9d59e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeca1cbc-dd6f-493b-979f-757d53e09eb2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:43:11 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:43:11 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f015d6a-8317-4123-9ffe-b6139bc41e69]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG os_brick.utils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:43:11 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updating existing volume attachment record: 06babe97-c424-4fc6-888e-e67f79b61341 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:43:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:43:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'pci_requests' on Instance uuid 6a32f8b7-2e32-42a7-b600-fc88bcc577fd {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:15 user nova-compute[75100]: DEBUG nova.objects.instance [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'numa_topology' on Instance uuid 6a32f8b7-2e32-42a7-b600-fc88bcc577fd {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:15 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:43:15 user nova-compute[75100]: INFO nova.compute.claims [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Claim successful on node user
Nov 13 17:43:15 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:43:15 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:43:15 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:15 user nova-compute[75100]: INFO nova.network.neutron [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updating port 8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquired lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-f68e5b72-1530-4e6b-9f6f-b52b98e14cac req-998e1516-c0f9-4421-b2f5-522469977af3 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-changed-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG nova.compute.manager [req-f68e5b72-1530-4e6b-9f6f-b52b98e14cac req-998e1516-c0f9-4421-b2f5-522469977af3 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Refreshing instance network info cache due to event network-changed-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f68e5b72-1530-4e6b-9f6f-b52b98e14cac req-998e1516-c0f9-4421-b2f5-522469977af3 service nova] Acquiring lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG nova.network.neutron [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updating instance_info_cache with network_info: [{"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Releasing lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:43:16 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Creating image(s)
Nov 13 17:43:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "/opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "/opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG nova.objects.instance [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6a32f8b7-2e32-42a7-b600-fc88bcc577fd {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f68e5b72-1530-4e6b-9f6f-b52b98e14cac req-998e1516-c0f9-4421-b2f5-522469977af3 service nova] Acquired lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG nova.network.neutron [req-f68e5b72-1530-4e6b-9f6f-b52b98e14cac req-998e1516-c0f9-4421-b2f5-522469977af3 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Refreshing network info cache for port 8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG nova.objects.base [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Object Instance<6a32f8b7-2e32-42a7-b600-fc88bcc577fd> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "6db4f5b59dd41c55b58ae75de2b7992b93622bc2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:16 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6db4f5b59dd41c55b58ae75de2b7992b93622bc2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:18 user nova-compute[75100]: DEBUG nova.virt.images [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] ac4ad627-9a84-4f9c-bf3f-c15a7aef4751 was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 17:43:18 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:43:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2.part /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:18 user nova-compute[75100]: DEBUG nova.network.neutron [req-f68e5b72-1530-4e6b-9f6f-b52b98e14cac req-998e1516-c0f9-4421-b2f5-522469977af3 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updated VIF entry in instance network info cache for port 8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:43:18 user nova-compute[75100]: DEBUG nova.network.neutron [req-f68e5b72-1530-4e6b-9f6f-b52b98e14cac req-998e1516-c0f9-4421-b2f5-522469977af3 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updating instance_info_cache with network_info: [{"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:43:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f68e5b72-1530-4e6b-9f6f-b52b98e14cac req-998e1516-c0f9-4421-b2f5-522469977af3 service nova] Releasing lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:43:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2.part /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2.converted" returned: 0 in 0.506s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6db4f5b59dd41c55b58ae75de2b7992b93622bc2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.061s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2 --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "6db4f5b59dd41c55b58ae75de2b7992b93622bc2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6db4f5b59dd41c55b58ae75de2b7992b93622bc2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2 --force-share --output=json" returned: 0 in 0.231s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2,backing_fmt=raw /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2,backing_fmt=raw /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk 1073741824" returned: 0 in 0.071s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6db4f5b59dd41c55b58ae75de2b7992b93622bc2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2 --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG nova.objects.instance [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'migration_context' on Instance uuid 6a32f8b7-2e32-42a7-b600-fc88bcc577fd {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG nova.objects.base [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Object Instance<6a32f8b7-2e32-42a7-b600-fc88bcc577fd> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:43:19 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Rebasing disk image.
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:19 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 -F raw /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 -F raw /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk" returned: 0 in 2.660s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Ensure instance console log exists: /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Start _get_guest_xml network_info=[{"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6a486a56d3f129fd9d6a310f4014110b',container_format='bare',created_at=2023-11-13T17:41:18Z,direct_url=<?>,disk_format='qcow2',id=ac4ad627-9a84-4f9c-bf3f-c15a7aef4751,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2002205144-shelved',owner='db67a12bfc7f48b380175a6871012f25',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T17:41:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '06babe97-c424-4fc6-888e-e67f79b61341', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNWvDcqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '6a32f8b7-2e32-42a7-b600-fc88bcc577fd', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4206aad-359c-4f8d-9dfd-8da263a4fc16', 'serial': 'c4206aad-359c-4f8d-9dfd-8da263a4fc16'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:43:22 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:43:22 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6a486a56d3f129fd9d6a310f4014110b',container_format='bare',created_at=2023-11-13T17:41:18Z,direct_url=<?>,disk_format='qcow2',id=ac4ad627-9a84-4f9c-bf3f-c15a7aef4751,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2002205144-shelved',owner='db67a12bfc7f48b380175a6871012f25',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T17:41:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6a32f8b7-2e32-42a7-b600-fc88bcc577fd {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.objects.base [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Object Instance<6a32f8b7-2e32-42a7-b600-fc88bcc577fd> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNWvDcqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:43:22 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:43:22 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:43:22 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4ef280-7174-40f6-8c25-ca2dd1e07290]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:43:22 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd4b599-034f-476b-b7fa-176051976afc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16] added
Nov 13 17:43:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[212b23c4-b346-49e1-b6b1-da3892ff3c1f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0b7d51-4088-4fb2-8d8b-c833f93417f2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNWvDcqT {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VNWvDcqT" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6c1aca-b1f2-4936-9a99-2dd63c77e198]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VNWvDcqT'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac81d66-3b9b-4fe2-97ab-2ce495974130]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52a5ffe-d23d-413f-8abf-682838a5cfc9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:43:22 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:43:22 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:43:22 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 17:43:22 user nova-compute[75100]: 
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a824f9ba-8e75-45ea-a336-998e9d33b6ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16, portal: 172.16.0.220,3260]
Nov 13 17:43:22 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16, portal: 172.16.0.220,3260] successful.
Nov 13 17:43:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3fc758-dffc-4f80-b81f-f65e5cfb932a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[216c8c3c-cbb6-46c3-9248-9b5391af2df6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[714d06ee-7a82-45fa-8abc-74454c5675ff]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:22 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-ca8871e4-95f7-4524-859e-aac274d21505 req-40de3ed5-7af8-4c57-9cdd-e33a488b7469 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Received event network-changed-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-ca8871e4-95f7-4524-859e-aac274d21505 req-40de3ed5-7af8-4c57-9cdd-e33a488b7469 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Refreshing instance network info cache due to event network-changed-60a7b68d-60a8-4c5b-9d87-976a7cea4af4. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ca8871e4-95f7-4524-859e-aac274d21505 req-40de3ed5-7af8-4c57-9cdd-e33a488b7469 service nova] Acquiring lock "refresh_cache-6415b849-7cef-4ea4-83f8-ccc5fb2d052f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ca8871e4-95f7-4524-859e-aac274d21505 req-40de3ed5-7af8-4c57-9cdd-e33a488b7469 service nova] Acquired lock "refresh_cache-6415b849-7cef-4ea4-83f8-ccc5fb2d052f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-ca8871e4-95f7-4524-859e-aac274d21505 req-40de3ed5-7af8-4c57-9cdd-e33a488b7469 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Refreshing network info cache for port 60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-ca8871e4-95f7-4524-859e-aac274d21505 req-40de3ed5-7af8-4c57-9cdd-e33a488b7469 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Updated VIF entry in instance network info cache for port 60a7b68d-60a8-4c5b-9d87-976a7cea4af4. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-ca8871e4-95f7-4524-859e-aac274d21505 req-40de3ed5-7af8-4c57-9cdd-e33a488b7469 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Updating instance_info_cache with network_info: [{"id": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "address": "fa:16:3e:1b:44:2f", "network": {"id": "914537bd-569c-44e7-a4ff-7c01056ae14f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425334271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fed1cab4b1646748950eeb97bae09e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60a7b68d-60", "ovs_interfaceid": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ca8871e4-95f7-4524-859e-aac274d21505 req-40de3ed5-7af8-4c57-9cdd-e33a488b7469 service nova] Releasing lock "refresh_cache-6415b849-7cef-4ea4-83f8-ccc5fb2d052f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNWvDcqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23532653661626438', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:43:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532653661626438', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2002205144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2002205144',id=42,image_ref='ac4ad627-9a84-4f9c-bf3f-c15a7aef4751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-457334197',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='db67a12bfc7f48b380175a6871012f25',ramdisk_id='',reservation_id='r-senzr9dj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1414200693',owner_user_name='tempest-AttachVolumeShelveTestJSON-1414200693-project-member',shelved_at='2023-11-13T17:41:22.772859',shelved_host='user',shelved_image_id='ac4ad627-9a84-4f9c-bf3f-c15a7aef4751'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54440f660c64141ad91285ddef65ca9',uuid=6a32f8b7-2e32-42a7-b600-fc88bcc577fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converting VIF {"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a32f8b7-2e32-42a7-b600-fc88bcc577fd {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.objects.base [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Object Instance<6a32f8b7-2e32-42a7-b600-fc88bcc577fd> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:43:24 user nova-compute[75100]:   <uuid>6a32f8b7-2e32-42a7-b600-fc88bcc577fd</uuid>
Nov 13 17:43:24 user nova-compute[75100]:   <name>instance-0000002a</name>
Nov 13 17:43:24 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:43:24 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:43:24 user nova-compute[75100]:   <metadata>
Nov 13 17:43:24 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:43:24 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:43:24 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2002205144</nova:name>
Nov 13 17:43:24 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:43:22</nova:creationTime>
Nov 13 17:43:24 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:43:24 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:43:24 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:43:24 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:43:24 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:43:24 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:43:24 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:43:24 user nova-compute[75100]:       <nova:owner>
Nov 13 17:43:24 user nova-compute[75100]:         <nova:user uuid="c54440f660c64141ad91285ddef65ca9">tempest-AttachVolumeShelveTestJSON-1414200693-project-member</nova:user>
Nov 13 17:43:24 user nova-compute[75100]:         <nova:project uuid="db67a12bfc7f48b380175a6871012f25">tempest-AttachVolumeShelveTestJSON-1414200693</nova:project>
Nov 13 17:43:24 user nova-compute[75100]:       </nova:owner>
Nov 13 17:43:24 user nova-compute[75100]:       <nova:root type="image" uuid="ac4ad627-9a84-4f9c-bf3f-c15a7aef4751"/>
Nov 13 17:43:24 user nova-compute[75100]:       <nova:ports>
Nov 13 17:43:24 user nova-compute[75100]:         <nova:port uuid="8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac">
Nov 13 17:43:24 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 17:43:24 user nova-compute[75100]:         </nova:port>
Nov 13 17:43:24 user nova-compute[75100]:       </nova:ports>
Nov 13 17:43:24 user nova-compute[75100]:     </nova:instance>
Nov 13 17:43:24 user nova-compute[75100]:   </metadata>
Nov 13 17:43:24 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:43:24 user nova-compute[75100]:     <system>
Nov 13 17:43:24 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:43:24 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:43:24 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:43:24 user nova-compute[75100]:       <entry name="serial">6a32f8b7-2e32-42a7-b600-fc88bcc577fd</entry>
Nov 13 17:43:24 user nova-compute[75100]:       <entry name="uuid">6a32f8b7-2e32-42a7-b600-fc88bcc577fd</entry>
Nov 13 17:43:24 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:43:24 user nova-compute[75100]:     </system>
Nov 13 17:43:24 user nova-compute[75100]:   </sysinfo>
Nov 13 17:43:24 user nova-compute[75100]:   <os>
Nov 13 17:43:24 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:43:24 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:43:24 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:43:24 user nova-compute[75100]:   </os>
Nov 13 17:43:24 user nova-compute[75100]:   <features>
Nov 13 17:43:24 user nova-compute[75100]:     <acpi/>
Nov 13 17:43:24 user nova-compute[75100]:     <apic/>
Nov 13 17:43:24 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:43:24 user nova-compute[75100]:   </features>
Nov 13 17:43:24 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:43:24 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:43:24 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:43:24 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:43:24 user nova-compute[75100]:   </clock>
Nov 13 17:43:24 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:43:24 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:43:24 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:43:24 user nova-compute[75100]:   </cpu>
Nov 13 17:43:24 user nova-compute[75100]:   <devices>
Nov 13 17:43:24 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:43:24 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:43:24 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk"/>
Nov 13 17:43:24 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:43:24 user nova-compute[75100]:     </disk>
Nov 13 17:43:24 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:43:24 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:43:24 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 13 17:43:24 user nova-compute[75100]:       <target dev="vdc" bus="virtio"/>
Nov 13 17:43:24 user nova-compute[75100]:       <serial>c4206aad-359c-4f8d-9dfd-8da263a4fc16</serial>
Nov 13 17:43:24 user nova-compute[75100]:     </disk>
Nov 13 17:43:24 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:43:24 user nova-compute[75100]:       <mac address="fa:16:3e:11:8d:15"/>
Nov 13 17:43:24 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:43:24 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:43:24 user nova-compute[75100]:       <target dev="tap8fbe0d9f-51"/>
Nov 13 17:43:24 user nova-compute[75100]:     </interface>
Nov 13 17:43:24 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:43:24 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/console.log" append="off"/>
Nov 13 17:43:24 user nova-compute[75100]:     </serial>
Nov 13 17:43:24 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:43:24 user nova-compute[75100]:     <video>
Nov 13 17:43:24 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:43:24 user nova-compute[75100]:     </video>
Nov 13 17:43:24 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:43:24 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:43:24 user nova-compute[75100]:     </rng>
Nov 13 17:43:24 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:43:24 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:43:24 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:43:24 user nova-compute[75100]:     </memballoon>
Nov 13 17:43:24 user nova-compute[75100]:   </devices>
Nov 13 17:43:24 user nova-compute[75100]: </domain>
Nov 13 17:43:24 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2002205144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2002205144',id=42,image_ref='ac4ad627-9a84-4f9c-bf3f-c15a7aef4751',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-457334197',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='db67a12bfc7f48b380175a6871012f25',ramdisk_id='',reservation_id='r-senzr9dj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1414200693',owner_user_name='tempest-AttachVolumeShelveTestJSON-1414200693-project-member',shelved_at='2023-11-13T17:41:22.772859',shelved_host='user',shelved_image_id='ac4ad627-9a84-4f9c-bf3f-c15a7aef4751'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54440f660c64141ad91285ddef65ca9',uuid=6a32f8b7-2e32-42a7-b600-fc88bcc577fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converting VIF {"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG os_vif [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c55f37de-733b-5d92-8fa4-1bf463a49b17', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8fbe0d9f-51, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8fbe0d9f-51, col_values=(('qos', UUID('9ce01038-cfd4-459e-8dcd-475c176dc7d1')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8fbe0d9f-51, col_values=(('external_ids', {'iface-id': '8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:8d:15', 'vm-uuid': '6a32f8b7-2e32-42a7-b600-fc88bcc577fd'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:24 user nova-compute[75100]: INFO os_vif [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51')
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] No VIF found with MAC fa:16:3e:11:8d:15, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lazy-loading 'flavor' on Instance uuid 6415b849-7cef-4ea4-83f8-ccc5fb2d052f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:24 user nova-compute[75100]: INFO nova.compute.manager [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Attaching volume 2a3932c7-9d5d-4fce-8092-d46960165594 to /dev/vdb
Nov 13 17:43:24 user nova-compute[75100]: DEBUG os_brick.utils [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc95279d-6cfa-4529-b1db-9024394dd5dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[826bfc15-bc7a-4759-8e11-47fd29c6d3bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[656cfd50-01b8-4436-8732-3a5516656f0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbd39b7-78aa-41ac-8dd7-d74573b48143]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:43:25 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b282a7da-c5df-43aa-a7a8-311f890dea3f]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG os_brick.utils [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Updating existing volume attachment record: 83c193e5-a93b-40b3-a928-5f3e1215e19b {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf781e08-32e6-4c5d-b719-2527be42ca95 req-352a3957-1c42-4d0b-a865-0f04632d7d4a service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf781e08-32e6-4c5d-b719-2527be42ca95 req-352a3957-1c42-4d0b-a865-0f04632d7d4a service nova] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf781e08-32e6-4c5d-b719-2527be42ca95 req-352a3957-1c42-4d0b-a865-0f04632d7d4a service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-cf781e08-32e6-4c5d-b719-2527be42ca95 req-352a3957-1c42-4d0b-a865-0f04632d7d4a service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-cf781e08-32e6-4c5d-b719-2527be42ca95 req-352a3957-1c42-4d0b-a865-0f04632d7d4a service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] No waiting events found dispatching network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:43:25 user nova-compute[75100]: WARNING nova.compute.manager [req-cf781e08-32e6-4c5d-b719-2527be42ca95 req-352a3957-1c42-4d0b-a865-0f04632d7d4a service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received unexpected event network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 17:43:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:43:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:43:27 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Instance spawned successfully.
Nov 13 17:43:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-83ec86e6-9203-482f-8db7-ba0d83a218b2 req-186e1e4a-a114-4bc7-9a6c-ffdf36aa1f1e service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:43:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-83ec86e6-9203-482f-8db7-ba0d83a218b2 req-186e1e4a-a114-4bc7-9a6c-ffdf36aa1f1e service nova] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-83ec86e6-9203-482f-8db7-ba0d83a218b2 req-186e1e4a-a114-4bc7-9a6c-ffdf36aa1f1e service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-83ec86e6-9203-482f-8db7-ba0d83a218b2 req-186e1e4a-a114-4bc7-9a6c-ffdf36aa1f1e service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-83ec86e6-9203-482f-8db7-ba0d83a218b2 req-186e1e4a-a114-4bc7-9a6c-ffdf36aa1f1e service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] No waiting events found dispatching network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:43:27 user nova-compute[75100]: WARNING nova.compute.manager [req-83ec86e6-9203-482f-8db7-ba0d83a218b2 req-186e1e4a-a114-4bc7-9a6c-ffdf36aa1f1e service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received unexpected event network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 17:43:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:43:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-26567701-93e0-4a46-8e66-5be8db389d1c tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.606s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qKIaPtMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:43:29 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:43:29 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:43:29 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef86dd7-fe6e-487f-89b7-49964b50dd87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:43:29 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68361ec-ed2a-4e13-9725-3678c67d1bb8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594] added
Nov 13 17:43:29 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7724f4e-0a07-4c96-a32c-64db12ff2d93]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9b1001-580f-44d5-a88a-c1b8007aa419]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qKIaPtMf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qKIaPtMf" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a65054-ecdb-460b-b596-02820ac0b81a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qKIaPtMf'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1871d3-47cd-4202-8c2d-f7099483b623]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1fcc90-9197-4eeb-994d-16901737bb29]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:29 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:29 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b28350-eb16-4b17-bb72-66402584994c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594, portal: 172.16.0.220,3260]
Nov 13 17:43:29 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594, portal: 172.16.0.220,3260] successful.
Nov 13 17:43:29 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4349bd-8d94-4c25-a17e-66626449cc45]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac74a1c-62d7-4b73-a307-db077392f195]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:29 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:43:29 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:29 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:43:29 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d717f0-deb4-4cc9-b6ad-5708558435eb]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:29 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:43:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:43:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qKIaPtMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:43:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:43:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23631356534653434', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:43:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631356534653434', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:43:30 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lazy-loading 'flavor' on Instance uuid 6415b849-7cef-4ea4-83f8-ccc5fb2d052f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:43:30 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:43:30 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 13 17:43:30 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:43:30 user nova-compute[75100]:   <serial>2a3932c7-9d5d-4fce-8092-d46960165594</serial>
Nov 13 17:43:30 user nova-compute[75100]: </disk>
Nov 13 17:43:30 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:43:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:43:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:43:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] No VIF found with MAC fa:16:3e:1b:44:2f, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:43:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c459112b-c54f-4778-9863-51389c923ab5 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.217s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lazy-loading 'flavor' on Instance uuid 6415b849-7cef-4ea4-83f8-ccc5fb2d052f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:35 user nova-compute[75100]: INFO nova.compute.manager [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Attaching volume d4ecd784-97e7-42b8-80a5-629786d03984 to /dev/vdc
Nov 13 17:43:35 user nova-compute[75100]: DEBUG os_brick.utils [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8491e38-1c13-447c-9b0a-a2f027714286]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cc5049-67e0-4cce-a0d5-c61a246f96c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f2694e-a200-45c1-8484-80bb3907f5fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7348596-3387-4dc4-806c-cedba947c31e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:43:35 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba41456-d893-4aa9-b48e-3550edb23bff]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG os_brick.utils [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Updating existing volume attachment record: c0592b90-e31c-44a5-aeb1-3b09076cb670 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:43:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:43:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:43:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:43:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dRfXeWno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:43:39 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:43:39 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:43:39 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe172fbf-afa9-47bc-8649-2eab1c4212b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:43:39 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1706c4c9-0808-4c05-9e11-14ec72b9570d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984] added
Nov 13 17:43:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[10982891-5669-40ff-88ee-68f5add7338b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca4661d-2234-4d44-8dfb-e57d9a82d87f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dRfXeWno {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dRfXeWno" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2370081a-12ad-479b-bd5d-3869621e8719]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dRfXeWno'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b8e152-5e2d-4748-a06e-b81cbd2d3348]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6524826-3d25-4e89-a866-a33b4eac53b4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:39 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:43:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:39 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:43:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0d9caa-bcf4-4c5a-b1c3-692d446e2444]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984, portal: 172.16.0.220,3260]
Nov 13 17:43:39 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984, portal: 172.16.0.220,3260] successful.
Nov 13 17:43:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7517c99-8165-4186-a584-4d3e7a3e84bd]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f690032-0483-4d86-a139-94ce60a723ff]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:39 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:43:39 user nova-compute[75100]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 (non-flash)
Nov 13 17:43:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:39 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:43:39 user nova-compute[75100]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 (non-flash)
Nov 13 17:43:39 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac23a64-077d-45c2-a5a2-f3b5e03e6712]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:39 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-0474e023-2f1b-4dee-8015-61de2ddc6016 req-ccc4a910-bf15-4806-8e2c-a6e9fe382d73 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-changed-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-0474e023-2f1b-4dee-8015-61de2ddc6016 req-ccc4a910-bf15-4806-8e2c-a6e9fe382d73 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Refreshing instance network info cache due to event network-changed-b367db30-a5c0-4b4b-b655-d9288eb2be67. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0474e023-2f1b-4dee-8015-61de2ddc6016 req-ccc4a910-bf15-4806-8e2c-a6e9fe382d73 service nova] Acquiring lock "refresh_cache-ce4d18fc-5cf8-4916-97be-a1943a6ddd34" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0474e023-2f1b-4dee-8015-61de2ddc6016 req-ccc4a910-bf15-4806-8e2c-a6e9fe382d73 service nova] Acquired lock "refresh_cache-ce4d18fc-5cf8-4916-97be-a1943a6ddd34" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG nova.network.neutron [req-0474e023-2f1b-4dee-8015-61de2ddc6016 req-ccc4a910-bf15-4806-8e2c-a6e9fe382d73 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Refreshing network info cache for port b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dRfXeWno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26236643739643965', 'path': '/dev/sdd'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236643739643965', 'path': '/dev/sdd'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lazy-loading 'flavor' on Instance uuid 6415b849-7cef-4ea4-83f8-ccc5fb2d052f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:43:40 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:43:40 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 13 17:43:40 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 13 17:43:40 user nova-compute[75100]:   <serial>d4ecd784-97e7-42b8-80a5-629786d03984</serial>
Nov 13 17:43:40 user nova-compute[75100]: </disk>
Nov 13 17:43:40 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lazy-loading 'flavor' on Instance uuid ce4d18fc-5cf8-4916-97be-a1943a6ddd34 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG nova.network.neutron [req-0474e023-2f1b-4dee-8015-61de2ddc6016 req-ccc4a910-bf15-4806-8e2c-a6e9fe382d73 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Updated VIF entry in instance network info cache for port b367db30-a5c0-4b4b-b655-d9288eb2be67. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG nova.network.neutron [req-0474e023-2f1b-4dee-8015-61de2ddc6016 req-ccc4a910-bf15-4806-8e2c-a6e9fe382d73 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Updating instance_info_cache with network_info: [{"id": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "address": "fa:16:3e:9f:a3:4c", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb367db30-a5", "ovs_interfaceid": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0474e023-2f1b-4dee-8015-61de2ddc6016 req-ccc4a910-bf15-4806-8e2c-a6e9fe382d73 service nova] Releasing lock "refresh_cache-ce4d18fc-5cf8-4916-97be-a1943a6ddd34" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:40 user nova-compute[75100]: INFO nova.compute.manager [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Attaching volume 4d3c0373-38b5-4a0b-937b-8beeaf4ae776 to /dev/vdb
Nov 13 17:43:41 user nova-compute[75100]: DEBUG os_brick.utils [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3896555b-8dc7-49a5-8e19-6f95c2ec86dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Updating instance_info_cache with network_info: [{"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[047a72ca-43bb-425f-b133-745ef8c5cc3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5647d48-b4b9-4178-b531-c07e82a6d045]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[62908116-0659-49a0-8169-c14b7cb2fcab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:43:41 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a53048-8db8-45d2-b6ed-7a43c79668ce]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG os_brick.utils [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Updating existing volume attachment record: 336e1603-e169-4287-a701-206af27d8fb2 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] No VIF found with MAC fa:16:3e:1b:44:2f, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-42ea6a2c-f1fb-4fa8-bf1c-8872b089c15a tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.325s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.005s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:42 user nova-compute[75100]: INFO nova.compute.manager [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Detaching volume d4ecd784-97e7-42b8-80a5-629786d03984
Nov 13 17:43:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:42 user nova-compute[75100]: INFO nova.virt.block_device [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Attempting to driver detach volume d4ecd784-97e7-42b8-80a5-629786d03984 from mountpoint /dev/vdc
Nov 13 17:43:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Attempting to detach device vdc from instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:43:42 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:43:42 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 13 17:43:42 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 13 17:43:42 user nova-compute[75100]:   <serial>d4ecd784-97e7-42b8-80a5-629786d03984</serial>
Nov 13 17:43:42 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 17:43:42 user nova-compute[75100]: </disk>
Nov 13 17:43:42 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:43:42 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Successfully detached device vdc from instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f from the persistent domain config.
Nov 13 17:43:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:43:42 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:43:42 user nova-compute[75100]:   <source dev="/dev/sdd"/>
Nov 13 17:43:42 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 13 17:43:42 user nova-compute[75100]:   <serial>d4ecd784-97e7-42b8-80a5-629786d03984</serial>
Nov 13 17:43:42 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 17:43:42 user nova-compute[75100]: </disk>
Nov 13 17:43:42 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:43 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:43:43 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:43:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8325MB free_disk=24.98004150390625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f0bf103e-23eb-486a-a5df-9f3e66d4d076 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f589271c-7e6c-4352-8b85-8a7aca61dc7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ce4d18fc-5cf8-4916-97be-a1943a6ddd34 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:43:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:43:44 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:43:44 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:43:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:43:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajMheKtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:43:45 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:43:45 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:43:45 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[de145ce5-d8d7-4b2e-8745-05fac3232505]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:43:45 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d71a0a0-71e4-498e-9693-55e819d3b9ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776] added
Nov 13 17:43:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b74db05-a5d4-4eec-bd04-df8453be3dda]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[524c61e4-82ea-4f56-b5fd-0a293a53b685]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajMheKtk {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ajMheKtk" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc1e7d8-1e1b-4820-b1cc-fc70d161607d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ajMheKtk'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a7e48-7296-44dd-88f4-fbbe6d1134a4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b851f9-ffb5-48a7-bfeb-8e4a5a49ae98]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1add3bfc-e248-4972-ab19-a1b4c20cd48e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776, portal: 172.16.0.220,3260]
Nov 13 17:43:45 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776, portal: 172.16.0.220,3260] successful.
Nov 13 17:43:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43ef655-d243-4f85-83ee-9f6b1ae94f40]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b5b034-5c68-4d1e-9dd0-fd563b4f251a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 (non-flash)
Nov 13 17:43:45 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f41b87-2f1a-4f16-ab1f-bbc57224a710]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:43:45 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:43:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:43:46 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:43:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajMheKtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:43:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:43:46 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23365633539633063', 'path': '/dev/sde'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:43:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365633539633063', 'path': '/dev/sde'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:43:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lazy-loading 'flavor' on Instance uuid ce4d18fc-5cf8-4916-97be-a1943a6ddd34 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:43:46 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:43:46 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 13 17:43:46 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:43:46 user nova-compute[75100]:   <serial>4d3c0373-38b5-4a0b-937b-8beeaf4ae776</serial>
Nov 13 17:43:46 user nova-compute[75100]: </disk>
Nov 13 17:43:46 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:43:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:43:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:43:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] No VIF found with MAC fa:16:3e:9f:a3:4c, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:43:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-77bd3dbb-3155-40ed-8487-1d32c24193bc tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.109s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:43:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:48 user nova-compute[75100]: INFO nova.compute.manager [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Detaching volume 4d3c0373-38b5-4a0b-937b-8beeaf4ae776
Nov 13 17:43:48 user nova-compute[75100]: INFO nova.virt.block_device [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Attempting to driver detach volume 4d3c0373-38b5-4a0b-937b-8beeaf4ae776 from mountpoint /dev/vdb
Nov 13 17:43:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Attempting to detach device vdb from instance ce4d18fc-5cf8-4916-97be-a1943a6ddd34 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:43:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:43:48 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:43:48 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 13 17:43:48 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:43:48 user nova-compute[75100]:   <serial>4d3c0373-38b5-4a0b-937b-8beeaf4ae776</serial>
Nov 13 17:43:48 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:43:48 user nova-compute[75100]: </disk>
Nov 13 17:43:48 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:43:48 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Successfully detached device vdb from instance ce4d18fc-5cf8-4916-97be-a1943a6ddd34 from the persistent domain config.
Nov 13 17:43:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce4d18fc-5cf8-4916-97be-a1943a6ddd34 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:43:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:43:48 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:43:48 user nova-compute[75100]:   <source dev="/dev/sde"/>
Nov 13 17:43:48 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:43:48 user nova-compute[75100]:   <serial>4d3c0373-38b5-4a0b-937b-8beeaf4ae776</serial>
Nov 13 17:43:48 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:43:48 user nova-compute[75100]: </disk>
Nov 13 17:43:48 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:43:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce4d18fc-5cf8-4916-97be-a1943a6ddd34 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:43:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:43:50 user nova-compute[75100]: INFO nova.compute.claims [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Claim successful on node user
Nov 13 17:43:50 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:43:50 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:43:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG nova.policy [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fde156049464deba4b3a3125712baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6352bffe5fa144f996e2ba07f69f4ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:43:50 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Creating image(s)
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "/opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "/opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:50 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk 1073741824" returned: 0 in 0.056s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Successfully created port: edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Cannot resize image /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Ensure instance console log exists: /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Successfully updated port: edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "refresh_cache-fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquired lock "refresh_cache-fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-84d996b4-bd3b-40dc-a1dd-bd4f31bdb12e req-4a68458f-d29e-42d5-ab65-a0caf727c74e service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Received event network-changed-edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.compute.manager [req-84d996b4-bd3b-40dc-a1dd-bd4f31bdb12e req-4a68458f-d29e-42d5-ab65-a0caf727c74e service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Refreshing instance network info cache due to event network-changed-edf99438-4f5d-4f9e-b4bf-0b43cf706edc. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-84d996b4-bd3b-40dc-a1dd-bd4f31bdb12e req-4a68458f-d29e-42d5-ab65-a0caf727c74e service nova] Acquiring lock "refresh_cache-fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.network.neutron [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Updating instance_info_cache with network_info: [{"id": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "address": "fa:16:3e:fe:0a:b3", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf99438-4f", "ovs_interfaceid": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Releasing lock "refresh_cache-fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Instance network_info: |[{"id": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "address": "fa:16:3e:fe:0a:b3", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf99438-4f", "ovs_interfaceid": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-84d996b4-bd3b-40dc-a1dd-bd4f31bdb12e req-4a68458f-d29e-42d5-ab65-a0caf727c74e service nova] Acquired lock "refresh_cache-fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.network.neutron [req-84d996b4-bd3b-40dc-a1dd-bd4f31bdb12e req-4a68458f-d29e-42d5-ab65-a0caf727c74e service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Refreshing network info cache for port edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Start _get_guest_xml network_info=[{"id": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "address": "fa:16:3e:fe:0a:b3", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf99438-4f", "ovs_interfaceid": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:43:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:43:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-670976538',display_name='tempest-AttachVolumeNegativeTest-server-670976538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-670976538',id=45,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwyeUaUW79TbkFPsNW712asprzHeIjJqhyHSiCtb8vmIjldf02Jiynwdxp/TR0oiGIFnN6Ht7JXHSoXe7bZnWOWU2BNrrACxF5O6yBE4raKMLejzwCQyR5sIJkHYTnfKw==',key_name='tempest-keypair-1498095666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6352bffe5fa144f996e2ba07f69f4ee4',ramdisk_id='',reservation_id='r-ap7ftpxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2126330685',owner_user_name='tempest-AttachVolumeNegativeTest-2126330685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fde156049464deba4b3a3125712baa9',uuid=fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "address": "fa:16:3e:fe:0a:b3", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf99438-4f", "ovs_interfaceid": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converting VIF {"id": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "address": "fa:16:3e:fe:0a:b3", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf99438-4f", "ovs_interfaceid": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:0a:b3,bridge_name='br-int',has_traffic_filtering=True,id=edf99438-4f5d-4f9e-b4bf-0b43cf706edc,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf99438-4f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'pci_devices' on Instance uuid fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:43:52 user nova-compute[75100]:   <uuid>fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58</uuid>
Nov 13 17:43:52 user nova-compute[75100]:   <name>instance-0000002d</name>
Nov 13 17:43:52 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:43:52 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:43:52 user nova-compute[75100]:   <metadata>
Nov 13 17:43:52 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:43:52 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:43:52 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeNegativeTest-server-670976538</nova:name>
Nov 13 17:43:52 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:43:52</nova:creationTime>
Nov 13 17:43:52 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:43:52 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:43:52 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:43:52 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:43:52 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:43:52 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:43:52 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:43:52 user nova-compute[75100]:       <nova:owner>
Nov 13 17:43:52 user nova-compute[75100]:         <nova:user uuid="9fde156049464deba4b3a3125712baa9">tempest-AttachVolumeNegativeTest-2126330685-project-member</nova:user>
Nov 13 17:43:52 user nova-compute[75100]:         <nova:project uuid="6352bffe5fa144f996e2ba07f69f4ee4">tempest-AttachVolumeNegativeTest-2126330685</nova:project>
Nov 13 17:43:52 user nova-compute[75100]:       </nova:owner>
Nov 13 17:43:52 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:43:52 user nova-compute[75100]:       <nova:ports>
Nov 13 17:43:52 user nova-compute[75100]:         <nova:port uuid="edf99438-4f5d-4f9e-b4bf-0b43cf706edc">
Nov 13 17:43:52 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 17:43:52 user nova-compute[75100]:         </nova:port>
Nov 13 17:43:52 user nova-compute[75100]:       </nova:ports>
Nov 13 17:43:52 user nova-compute[75100]:     </nova:instance>
Nov 13 17:43:52 user nova-compute[75100]:   </metadata>
Nov 13 17:43:52 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:43:52 user nova-compute[75100]:     <system>
Nov 13 17:43:52 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:43:52 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:43:52 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:43:52 user nova-compute[75100]:       <entry name="serial">fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58</entry>
Nov 13 17:43:52 user nova-compute[75100]:       <entry name="uuid">fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58</entry>
Nov 13 17:43:52 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:43:52 user nova-compute[75100]:     </system>
Nov 13 17:43:52 user nova-compute[75100]:   </sysinfo>
Nov 13 17:43:52 user nova-compute[75100]:   <os>
Nov 13 17:43:52 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:43:52 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:43:52 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:43:52 user nova-compute[75100]:   </os>
Nov 13 17:43:52 user nova-compute[75100]:   <features>
Nov 13 17:43:52 user nova-compute[75100]:     <acpi/>
Nov 13 17:43:52 user nova-compute[75100]:     <apic/>
Nov 13 17:43:52 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:43:52 user nova-compute[75100]:   </features>
Nov 13 17:43:52 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:43:52 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:43:52 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:43:52 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:43:52 user nova-compute[75100]:   </clock>
Nov 13 17:43:52 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:43:52 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:43:52 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:43:52 user nova-compute[75100]:   </cpu>
Nov 13 17:43:52 user nova-compute[75100]:   <devices>
Nov 13 17:43:52 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:43:52 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:43:52 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk"/>
Nov 13 17:43:52 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:43:52 user nova-compute[75100]:     </disk>
Nov 13 17:43:52 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:43:52 user nova-compute[75100]:       <mac address="fa:16:3e:fe:0a:b3"/>
Nov 13 17:43:52 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:43:52 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:43:52 user nova-compute[75100]:       <target dev="tapedf99438-4f"/>
Nov 13 17:43:52 user nova-compute[75100]:     </interface>
Nov 13 17:43:52 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:43:52 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/console.log" append="off"/>
Nov 13 17:43:52 user nova-compute[75100]:     </serial>
Nov 13 17:43:52 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:43:52 user nova-compute[75100]:     <video>
Nov 13 17:43:52 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:43:52 user nova-compute[75100]:     </video>
Nov 13 17:43:52 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:43:52 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:43:52 user nova-compute[75100]:     </rng>
Nov 13 17:43:52 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:43:52 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:43:52 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:43:52 user nova-compute[75100]:     </memballoon>
Nov 13 17:43:52 user nova-compute[75100]:   </devices>
Nov 13 17:43:52 user nova-compute[75100]: </domain>
Nov 13 17:43:52 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-670976538',display_name='tempest-AttachVolumeNegativeTest-server-670976538',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-670976538',id=45,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwyeUaUW79TbkFPsNW712asprzHeIjJqhyHSiCtb8vmIjldf02Jiynwdxp/TR0oiGIFnN6Ht7JXHSoXe7bZnWOWU2BNrrACxF5O6yBE4raKMLejzwCQyR5sIJkHYTnfKw==',key_name='tempest-keypair-1498095666',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6352bffe5fa144f996e2ba07f69f4ee4',ramdisk_id='',reservation_id='r-ap7ftpxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2126330685',owner_user_name='tempest-AttachVolumeNegativeTest-2126330685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fde156049464deba4b3a3125712baa9',uuid=fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "address": "fa:16:3e:fe:0a:b3", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf99438-4f", "ovs_interfaceid": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converting VIF {"id": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "address": "fa:16:3e:fe:0a:b3", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf99438-4f", "ovs_interfaceid": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:0a:b3,bridge_name='br-int',has_traffic_filtering=True,id=edf99438-4f5d-4f9e-b4bf-0b43cf706edc,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf99438-4f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG os_vif [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:0a:b3,bridge_name='br-int',has_traffic_filtering=True,id=edf99438-4f5d-4f9e-b4bf-0b43cf706edc,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf99438-4f') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b48ecb9-ff9c-5af5-9a25-7098b6837747', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedf99438-4f, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedf99438-4f, col_values=(('qos', UUID('181e5b7d-a6e2-4cd8-b9ef-2865e7b691f6')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedf99438-4f, col_values=(('external_ids', {'iface-id': 'edf99438-4f5d-4f9e-b4bf-0b43cf706edc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:0a:b3', 'vm-uuid': 'fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:52 user nova-compute[75100]: INFO os_vif [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:0a:b3,bridge_name='br-int',has_traffic_filtering=True,id=edf99438-4f5d-4f9e-b4bf-0b43cf706edc,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf99438-4f')
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No VIF found with MAC fa:16:3e:fe:0a:b3, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.network.neutron [req-84d996b4-bd3b-40dc-a1dd-bd4f31bdb12e req-4a68458f-d29e-42d5-ab65-a0caf727c74e service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Updated VIF entry in instance network info cache for port edf99438-4f5d-4f9e-b4bf-0b43cf706edc. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG nova.network.neutron [req-84d996b4-bd3b-40dc-a1dd-bd4f31bdb12e req-4a68458f-d29e-42d5-ab65-a0caf727c74e service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Updating instance_info_cache with network_info: [{"id": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "address": "fa:16:3e:fe:0a:b3", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf99438-4f", "ovs_interfaceid": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-84d996b4-bd3b-40dc-a1dd-bd4f31bdb12e req-4a68458f-d29e-42d5-ab65-a0caf727c74e service nova] Releasing lock "refresh_cache-fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:43:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-8aed819d-05ab-41ad-8889-26b092643cff req-7517198c-2452-4d34-9a02-0c59b10e21ef service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Received event network-vif-plugged-edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:43:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8aed819d-05ab-41ad-8889-26b092643cff req-7517198c-2452-4d34-9a02-0c59b10e21ef service nova] Acquiring lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8aed819d-05ab-41ad-8889-26b092643cff req-7517198c-2452-4d34-9a02-0c59b10e21ef service nova] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-8aed819d-05ab-41ad-8889-26b092643cff req-7517198c-2452-4d34-9a02-0c59b10e21ef service nova] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-8aed819d-05ab-41ad-8889-26b092643cff req-7517198c-2452-4d34-9a02-0c59b10e21ef service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] No waiting events found dispatching network-vif-plugged-edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:43:53 user nova-compute[75100]: WARNING nova.compute.manager [req-8aed819d-05ab-41ad-8889-26b092643cff req-7517198c-2452-4d34-9a02-0c59b10e21ef service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Received unexpected event network-vif-plugged-edf99438-4f5d-4f9e-b4bf-0b43cf706edc for instance with vm_state building and task_state spawning.
Nov 13 17:43:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:43:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Instance spawned successfully.
Nov 13 17:43:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:43:55 user nova-compute[75100]: INFO nova.compute.manager [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 13 17:43:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-c3f549de-b15b-44ab-875f-303a8d93ba2d req-4ba7d590-f009-4c1a-9367-4e957afd77a2 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Received event network-vif-plugged-edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c3f549de-b15b-44ab-875f-303a8d93ba2d req-4ba7d590-f009-4c1a-9367-4e957afd77a2 service nova] Acquiring lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c3f549de-b15b-44ab-875f-303a8d93ba2d req-4ba7d590-f009-4c1a-9367-4e957afd77a2 service nova] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c3f549de-b15b-44ab-875f-303a8d93ba2d req-4ba7d590-f009-4c1a-9367-4e957afd77a2 service nova] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-c3f549de-b15b-44ab-875f-303a8d93ba2d req-4ba7d590-f009-4c1a-9367-4e957afd77a2 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] No waiting events found dispatching network-vif-plugged-edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:43:55 user nova-compute[75100]: WARNING nova.compute.manager [req-c3f549de-b15b-44ab-875f-303a8d93ba2d req-4ba7d590-f009-4c1a-9367-4e957afd77a2 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Received unexpected event network-vif-plugged-edf99438-4f5d-4f9e-b4bf-0b43cf706edc for instance with vm_state building and task_state spawning.
Nov 13 17:43:56 user nova-compute[75100]: INFO nova.compute.manager [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Took 5.96 seconds to build instance.
Nov 13 17:43:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-0077795e-8fd3-404b-9836-56804f089913 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.055s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:43:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:43:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:43:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:02 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f is timed out.
Nov 13 17:44:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Successfully detached device vdc from instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f from the live domain config.
Nov 13 17:44:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dRfXeWno', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:44:02 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[037d7cc7-f8c9-434c-bb68-47cf13eed9ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:44:02 user nova-compute[75100]: No targets found.
Nov 13 17:44:02 user nova-compute[75100]: iSNS:
Nov 13 17:44:02 user nova-compute[75100]: No targets found.
Nov 13 17:44:02 user nova-compute[75100]: STATIC:
Nov 13 17:44:02 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16
Nov 13 17:44:02 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:44:02 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:44:02 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594
Nov 13 17:44:02 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:44:02 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:44:02 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776
Nov 13 17:44:02 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:44:02 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:44:02 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984
Nov 13 17:44:02 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:44:02 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:44:02 user nova-compute[75100]: FIRMWARE:
Nov 13 17:44:02 user nova-compute[75100]: No targets found.
Nov 13 17:44:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:44:02 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:44:02 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd8e80e-8972-4360-af90-c2a61242c894]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c912a6cc-e8f5-4fff-b722-c4a6d63735c4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:44:02 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:44:02 user nova-compute[75100]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 (non-flash)
Nov 13 17:44:02 user nova-compute[75100]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 (non-flash)
Nov 13 17:44:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:44:02 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:44:02 user nova-compute[75100]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 (non-flash)
Nov 13 17:44:02 user nova-compute[75100]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 (non-flash)
Nov 13 17:44:02 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c5044c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984'): ({'sdd'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Removing single pathed devices sdd {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[268ba7a3-b017-4923-9586-40e328f4f148]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[10447413-e54b-4289-a749-e6064b225d62]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Flushing IO for device /dev/sdd {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aeb064-4e70-430b-9313-0ec0dba0d2ee]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.066s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c246e3-c11c-4aa5-9abc-fdc0eaa44692]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] SCSI volumes sdd have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6ec8fa-d9a2-46ae-96cd-1342686bba03]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:44:02 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[966f6529-9b03-431c-b26f-42522c6cab51]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984, portal: 172.16.0.220,3260]
Nov 13 17:44:03 user nova-compute[75100]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984, portal: 172.16.0.220,3260] successful.
Nov 13 17:44:03 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:44:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ecd784-97e7-42b8-80a5-629786d03984 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:03 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0077d4-bd2a-4b63-a992-678e34b47e0c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:44:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:44:03 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] <== disconnect_volume: return (330ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:44:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:44:03 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lazy-loading 'flavor' on Instance uuid 6415b849-7cef-4ea4-83f8-ccc5fb2d052f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:44:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c3d410d6-0c13-44d9-8c3b-1cfa8d9ee59c tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.720s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:09 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce4d18fc-5cf8-4916-97be-a1943a6ddd34 is timed out.
Nov 13 17:44:09 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Successfully detached device vdb from instance ce4d18fc-5cf8-4916-97be-a1943a6ddd34 from the live domain config.
Nov 13 17:44:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ajMheKtk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:44:09 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c69e517-b9e2-4a8c-91ba-7163f82cb788]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:44:09 user nova-compute[75100]: No targets found.
Nov 13 17:44:09 user nova-compute[75100]: iSNS:
Nov 13 17:44:09 user nova-compute[75100]: No targets found.
Nov 13 17:44:09 user nova-compute[75100]: STATIC:
Nov 13 17:44:09 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16
Nov 13 17:44:09 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:44:09 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:44:09 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594
Nov 13 17:44:09 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:44:09 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:44:09 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776
Nov 13 17:44:09 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:44:09 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:44:09 user nova-compute[75100]: FIRMWARE:
Nov 13 17:44:09 user nova-compute[75100]: No targets found.
Nov 13 17:44:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:44:09 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:44:09 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02400d6-c488-4901-a2ce-081cc61e5b34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa15e93b-4c3d-4532-9bdb-a2598d2dbf7d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:44:09 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:44:09 user nova-compute[75100]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 (non-flash)
Nov 13 17:44:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:44:09 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:44:09 user nova-compute[75100]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 (non-flash)
Nov 13 17:44:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c271090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776'): ({'sde'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Removing single pathed devices sde {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[530ec992-6fe5-4631-b336-579472961add]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c79f5ad-245a-486f-94f3-30b55176fd96]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Flushing IO for device /dev/sde {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dda15b-f8a6-4083-bdf5-0defdc997d73]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4a3a18-d10d-46d3-ac52-be5f019aff56]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] SCSI volumes sde have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f366c-154c-41e4-aab5-b45c4e03371b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e844b5c-ffff-41c5-9a99-94a05605a584]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776, portal: 172.16.0.220,3260]
Nov 13 17:44:09 user nova-compute[75100]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776, portal: 172.16.0.220,3260] successful.
Nov 13 17:44:09 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3c0373-38b5-4a0b-937b-8beeaf4ae776 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac574aa-0206-44ed-968c-2464a1d76290]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] <== disconnect_volume: return (298ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:44:09 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:44:10 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lazy-loading 'flavor' on Instance uuid ce4d18fc-5cf8-4916-97be-a1943a6ddd34 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:44:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5676a2e1-9ae3-4f8e-aa38-452f3b4b7a01 tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.572s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:44:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:44:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:44:32 user nova-compute[75100]: INFO nova.compute.manager [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Detaching volume 2a3932c7-9d5d-4fce-8092-d46960165594
Nov 13 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:44:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:32 user nova-compute[75100]: INFO nova.virt.block_device [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Attempting to driver detach volume 2a3932c7-9d5d-4fce-8092-d46960165594 from mountpoint /dev/vdb
Nov 13 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Attempting to detach device vdb from instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:44:32 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:44:32 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 13 17:44:32 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:44:32 user nova-compute[75100]:   <serial>2a3932c7-9d5d-4fce-8092-d46960165594</serial>
Nov 13 17:44:32 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:44:32 user nova-compute[75100]: </disk>
Nov 13 17:44:32 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:44:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Successfully detached device vdb from instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f from the persistent domain config.
Nov 13 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:44:32 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:44:32 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 13 17:44:32 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:44:32 user nova-compute[75100]:   <serial>2a3932c7-9d5d-4fce-8092-d46960165594</serial>
Nov 13 17:44:32 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:44:32 user nova-compute[75100]: </disk>
Nov 13 17:44:32 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:44:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:44:37 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:44:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:44:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:44:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:44:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:44:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-c42973a4-4b86-4b37-9874-c4bdf9074e94 req-0f2c6bb8-7285-4bd8-abcc-836d2a5af00a service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-changed-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-c42973a4-4b86-4b37-9874-c4bdf9074e94 req-0f2c6bb8-7285-4bd8-abcc-836d2a5af00a service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Refreshing instance network info cache due to event network-changed-b367db30-a5c0-4b4b-b655-d9288eb2be67. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c42973a4-4b86-4b37-9874-c4bdf9074e94 req-0f2c6bb8-7285-4bd8-abcc-836d2a5af00a service nova] Acquiring lock "refresh_cache-ce4d18fc-5cf8-4916-97be-a1943a6ddd34" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c42973a4-4b86-4b37-9874-c4bdf9074e94 req-0f2c6bb8-7285-4bd8-abcc-836d2a5af00a service nova] Acquired lock "refresh_cache-ce4d18fc-5cf8-4916-97be-a1943a6ddd34" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG nova.network.neutron [req-c42973a4-4b86-4b37-9874-c4bdf9074e94 req-0f2c6bb8-7285-4bd8-abcc-836d2a5af00a service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Refreshing network info cache for port b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:39 user nova-compute[75100]: INFO nova.compute.manager [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Terminating instance
Nov 13 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-57ee1b96-d578-4783-bb9e-79c11ed95bba req-f872db62-a4ef-477c-9417-6586a3f1fac5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-vif-unplugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57ee1b96-d578-4783-bb9e-79c11ed95bba req-f872db62-a4ef-477c-9417-6586a3f1fac5 service nova] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57ee1b96-d578-4783-bb9e-79c11ed95bba req-f872db62-a4ef-477c-9417-6586a3f1fac5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-57ee1b96-d578-4783-bb9e-79c11ed95bba req-f872db62-a4ef-477c-9417-6586a3f1fac5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-57ee1b96-d578-4783-bb9e-79c11ed95bba req-f872db62-a4ef-477c-9417-6586a3f1fac5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] No waiting events found dispatching network-vif-unplugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-57ee1b96-d578-4783-bb9e-79c11ed95bba req-f872db62-a4ef-477c-9417-6586a3f1fac5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-vif-unplugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG nova.network.neutron [req-c42973a4-4b86-4b37-9874-c4bdf9074e94 req-0f2c6bb8-7285-4bd8-abcc-836d2a5af00a service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Updated VIF entry in instance network info cache for port b367db30-a5c0-4b4b-b655-d9288eb2be67. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG nova.network.neutron [req-c42973a4-4b86-4b37-9874-c4bdf9074e94 req-0f2c6bb8-7285-4bd8-abcc-836d2a5af00a service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Updating instance_info_cache with network_info: [{"id": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "address": "fa:16:3e:9f:a3:4c", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb367db30-a5", "ovs_interfaceid": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c42973a4-4b86-4b37-9874-c4bdf9074e94 req-0f2c6bb8-7285-4bd8-abcc-836d2a5af00a service nova] Releasing lock "refresh_cache-ce4d18fc-5cf8-4916-97be-a1943a6ddd34" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Instance destroyed successfully.
Nov 13 17:44:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lazy-loading 'resources' on Instance uuid ce4d18fc-5cf8-4916-97be-a1943a6ddd34 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1770230999',display_name='tempest-TestStampPattern-server-1770230999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1770230999',id=44,image_ref='ac7d6b50-1493-409a-8855-0c836288086d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrOJF+I3W+VJrAHWGtN2MBJOMvEMODLQzn5ApWc/HW7iPWY+6/PHmwlDqsSJlNM55EzzJ9KtnrIwnuukCA4w5GI3FhgGrJxENswyXMhu8EweYbo1/3V9R/qP3i6bwmSqA==',key_name='tempest-TestStampPattern-1218817336',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:41:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beeb8e861865462e80ed3a213a09f8b1',ramdisk_id='',reservation_id='r-7gvy571h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f589271c-7e6c-4352-8b85-8a7aca61dc7f',image_min_disk='1',image_min_ram='0',image_owner_id='beeb8e861865462e80ed3a213a09f8b1',image_owner_project_name='tempest-TestStampPattern-317206420',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-317206420-project-member',image_user_id='bc9396967a5f4666b8d1d4df794b31aa',owner_project_name='tempest-TestStampPattern-317206420',owner_user_name='tempest-TestStampPattern-317206420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:41:56Z,user_data=None,user_id='bc9396967a5f4666b8d1d4df794b31aa',uuid=ce4d18fc-5cf8-4916-97be-a1943a6ddd34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "address": "fa:16:3e:9f:a3:4c", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb367db30-a5", "ovs_interfaceid": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Converting VIF {"id": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "address": "fa:16:3e:9f:a3:4c", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb367db30-a5", "ovs_interfaceid": "b367db30-a5c0-4b4b-b655-d9288eb2be67", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=b367db30-a5c0-4b4b-b655-d9288eb2be67,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb367db30-a5') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG os_vif [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=b367db30-a5c0-4b4b-b655-d9288eb2be67,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb367db30-a5') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb367db30-a5, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4198b115-3373-429d-ab71-03aa82042e0a) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: INFO os_vif [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:a3:4c,bridge_name='br-int',has_traffic_filtering=True,id=b367db30-a5c0-4b4b-b655-d9288eb2be67,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb367db30-a5')
Nov 13 17:44:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Deleting instance files /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34_del
Nov 13 17:44:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Deletion of /opt/stack/data/nova/instances/ce4d18fc-5cf8-4916-97be-a1943a6ddd34_del complete
Nov 13 17:44:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:40 user nova-compute[75100]: INFO nova.compute.manager [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 13 17:44:40 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:44:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-861372a5-689a-4df2-baf6-8098f6f07818 req-dc8e6232-e5b6-4f09-9e6d-8151d9abca0b service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-vif-deleted-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:44:41 user nova-compute[75100]: INFO nova.compute.manager [req-861372a5-689a-4df2-baf6-8098f6f07818 req-dc8e6232-e5b6-4f09-9e6d-8151d9abca0b service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Neutron deleted interface b367db30-a5c0-4b4b-b655-d9288eb2be67; detaching it from the instance and deleting it from the info cache
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.network.neutron [req-861372a5-689a-4df2-baf6-8098f6f07818 req-dc8e6232-e5b6-4f09-9e6d-8151d9abca0b service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:44:41 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Took 0.80 seconds to deallocate network for instance.
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-861372a5-689a-4df2-baf6-8098f6f07818 req-dc8e6232-e5b6-4f09-9e6d-8151d9abca0b service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Detach interface failed, port_id=b367db30-a5c0-4b4b-b655-d9288eb2be67, reason: Instance ce4d18fc-5cf8-4916-97be-a1943a6ddd34 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updating instance_info_cache with network_info: [{"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-6a32f8b7-2e32-42a7-b600-fc88bcc577fd" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] No waiting events found dispatching network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:44:41 user nova-compute[75100]: WARNING nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received unexpected event network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 for instance with vm_state deleted and task_state None.
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] No waiting events found dispatching network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:44:41 user nova-compute[75100]: WARNING nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received unexpected event network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 for instance with vm_state deleted and task_state None.
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] No waiting events found dispatching network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:44:41 user nova-compute[75100]: WARNING nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received unexpected event network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 for instance with vm_state deleted and task_state None.
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-vif-unplugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] No waiting events found dispatching network-vif-unplugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:44:41 user nova-compute[75100]: WARNING nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received unexpected event network-vif-unplugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 for instance with vm_state deleted and task_state None.
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received event network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Acquiring lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] No waiting events found dispatching network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:44:41 user nova-compute[75100]: WARNING nova.compute.manager [req-9e5a41ce-e195-41c1-bfae-63afd572fc82 req-44a0df42-af3b-4225-bdc6-8737a03a80c5 service nova] [instance: ce4d18fc-5cf8-4916-97be-a1943a6ddd34] Received unexpected event network-vif-plugged-b367db30-a5c0-4b4b-b655-d9288eb2be67 for instance with vm_state deleted and task_state None.
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:42 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Deleted allocations for instance ce4d18fc-5cf8-4916-97be-a1943a6ddd34
Nov 13 17:44:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6abc6fdb-3b8a-42ef-98c1-8ba2acd2400e tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "ce4d18fc-5cf8-4916-97be-a1943a6ddd34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.523s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:42 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:44:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:44 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:44:44 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:44:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8309MB free_disk=24.950531005859375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f0bf103e-23eb-486a-a5df-9f3e66d4d076 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f589271c-7e6c-4352-8b85-8a7aca61dc7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:44:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:44:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:44:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:44:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:44:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:44:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:44:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f is timed out.
Nov 13 17:44:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Successfully detached device vdb from instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f from the live domain config.
Nov 13 17:44:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:44:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qKIaPtMf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:44:52 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:44:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:44:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:44:52 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a085e99a-68e1-47e3-9749-d122cfdff83e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:44:53 user nova-compute[75100]: No targets found.
Nov 13 17:44:53 user nova-compute[75100]: iSNS:
Nov 13 17:44:53 user nova-compute[75100]: No targets found.
Nov 13 17:44:53 user nova-compute[75100]: STATIC:
Nov 13 17:44:53 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16
Nov 13 17:44:53 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:44:53 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:44:53 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594
Nov 13 17:44:53 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:44:53 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:44:53 user nova-compute[75100]: FIRMWARE:
Nov 13 17:44:53 user nova-compute[75100]: No targets found.
Nov 13 17:44:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:44:53 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:44:53 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[04be9602-3b14-4d3b-8c46-92d169c21090]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ab6849-e038-4f71-a3af-1676c327b4c1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:44:53 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:44:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:44:53 user nova-compute[75100]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 (non-flash)
Nov 13 17:44:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38bb4790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1fc806-1774-4bc3-835d-56461a94e165]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d2f930-2252-4a5c-b35d-65208b55044e]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9740953-f35f-44a1-8fc2-bead2f43a79b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4382712b-a6c2-486a-acc0-a5b963920a16]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c7faa2-b6a5-49b8-84a3-e64b832b9e9f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b0ffee-ca5a-43f6-90ff-e53d77cedbd0]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594, portal: 172.16.0.220,3260]
Nov 13 17:44:53 user nova-compute[75100]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594, portal: 172.16.0.220,3260] successful.
Nov 13 17:44:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a3932c7-9d5d-4fce-8092-d46960165594 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6cd0fd-1280-4bf5-992b-5c2b9adde8e2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] <== disconnect_volume: return (288ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:44:53 user nova-compute[75100]: DEBUG nova.objects.instance [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lazy-loading 'flavor' on Instance uuid 6415b849-7cef-4ea4-83f8-ccc5fb2d052f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:44:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-3df9a8b4-2a70-4f54-9e60-2923ffc15c52 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.575s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:44:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:44:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:44:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:44:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:44:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:44:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:45:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:01 user nova-compute[75100]: INFO nova.compute.manager [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Detaching volume c4206aad-359c-4f8d-9dfd-8da263a4fc16
Nov 13 17:45:01 user nova-compute[75100]: INFO nova.virt.block_device [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Attempting to driver detach volume c4206aad-359c-4f8d-9dfd-8da263a4fc16 from mountpoint /dev/vdc
Nov 13 17:45:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Attempting to detach device vdc from instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:45:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:45:01 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:45:01 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:45:01 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 13 17:45:01 user nova-compute[75100]:   <serial>c4206aad-359c-4f8d-9dfd-8da263a4fc16</serial>
Nov 13 17:45:01 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 17:45:01 user nova-compute[75100]: </disk>
Nov 13 17:45:01 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:45:01 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Successfully detached device vdc from instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd from the persistent domain config.
Nov 13 17:45:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:45:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:45:01 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:45:01 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:45:01 user nova-compute[75100]:   <target dev="vdc" bus="virtio"/>
Nov 13 17:45:01 user nova-compute[75100]:   <serial>c4206aad-359c-4f8d-9dfd-8da263a4fc16</serial>
Nov 13 17:45:01 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 17:45:01 user nova-compute[75100]: </disk>
Nov 13 17:45:01 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:45:01 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:45:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:45:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:45:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:45:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:45:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:45:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:45:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:45:21 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd is timed out.
Nov 13 17:45:21 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Successfully detached device vdc from instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd from the live domain config.
Nov 13 17:45:21 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VNWvDcqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:45:21 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62fd7d0-7688-49cd-92fa-850cd1322b75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:45:21 user nova-compute[75100]: No targets found.
Nov 13 17:45:21 user nova-compute[75100]: iSNS:
Nov 13 17:45:21 user nova-compute[75100]: No targets found.
Nov 13 17:45:21 user nova-compute[75100]: STATIC:
Nov 13 17:45:21 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16
Nov 13 17:45:21 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:45:21 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:45:21 user nova-compute[75100]: FIRMWARE:
Nov 13 17:45:21 user nova-compute[75100]: No targets found.
Nov 13 17:45:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:45:21 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:45:21 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bca2c6-4350-4c03-a60b-ee9251952f3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f71c66-d95c-48c7-bb92-2a9725edc5bd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:45:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 (non-flash)
Nov 13 17:45:21 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38bb4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a5bb8e-8506-48a6-ae20-5ca4f178ed44]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f035061f-f056-4cb6-bfc2-2f8a9f06ce35]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deeb71e-b744-4f26-a0cd-46a0143b7c6a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[18026710-340b-4657-aacd-3dd54a3bffa6]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8955742a-a4df-44f3-829b-898cdf1d2374]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:45:21 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd70414-ddb1-49b9-a512-9e35948d2bb1]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16, portal: 172.16.0.220,3260]
Nov 13 17:45:22 user nova-compute[75100]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16, portal: 172.16.0.220,3260] successful.
Nov 13 17:45:22 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4206aad-359c-4f8d-9dfd-8da263a4fc16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4527484-2c6b-455f-91b8-7f617972e43b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] <== disconnect_volume: return (293ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'flavor' on Instance uuid 6a32f8b7-2e32-42a7-b600-fc88bcc577fd {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d1a58e09-d180-4973-b76f-a236ff03b4bd tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.693s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:22 user nova-compute[75100]: INFO nova.compute.manager [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Terminating instance
Nov 13 17:45:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-ed652adb-d23f-4dd0-b229-83c5c74c2a11 req-455ee29a-567b-414c-a730-d7ed33fd00e4 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Received event network-vif-unplugged-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ed652adb-d23f-4dd0-b229-83c5c74c2a11 req-455ee29a-567b-414c-a730-d7ed33fd00e4 service nova] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ed652adb-d23f-4dd0-b229-83c5c74c2a11 req-455ee29a-567b-414c-a730-d7ed33fd00e4 service nova] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ed652adb-d23f-4dd0-b229-83c5c74c2a11 req-455ee29a-567b-414c-a730-d7ed33fd00e4 service nova] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-ed652adb-d23f-4dd0-b229-83c5c74c2a11 req-455ee29a-567b-414c-a730-d7ed33fd00e4 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] No waiting events found dispatching network-vif-unplugged-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-ed652adb-d23f-4dd0-b229-83c5c74c2a11 req-455ee29a-567b-414c-a730-d7ed33fd00e4 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Received event network-vif-unplugged-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:45:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Instance destroyed successfully.
Nov 13 17:45:23 user nova-compute[75100]: DEBUG nova.objects.instance [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lazy-loading 'resources' on Instance uuid 6415b849-7cef-4ea4-83f8-ccc5fb2d052f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:41:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1173730006',display_name='tempest-TestServerVolumeAttachmentScenario-server-1173730006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1173730006',id=43,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFu8tV6Jpigo6zBzeKhfQQPPhvLnNpdPi4pYwxX4NJD10apNyDHcKvA+3FtOcHinfPJw/d1yg+U9/NZaDlKQ7of4JHgyxEXFcVQdmAggzGLEy1+dziwo2kyzjUpEGbftiw==',key_name='tempest-keypair-1703532500',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:41:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6fed1cab4b1646748950eeb97bae09e3',ramdisk_id='',reservation_id='r-0fd537zg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1234263029',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1234263029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71dd4a1af0fb40cabbcaaa6766a3d760',uuid=6415b849-7cef-4ea4-83f8-ccc5fb2d052f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "address": "fa:16:3e:1b:44:2f", "network": {"id": "914537bd-569c-44e7-a4ff-7c01056ae14f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425334271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fed1cab4b1646748950eeb97bae09e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60a7b68d-60", "ovs_interfaceid": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Converting VIF {"id": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "address": "fa:16:3e:1b:44:2f", "network": {"id": "914537bd-569c-44e7-a4ff-7c01056ae14f", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-425334271-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fed1cab4b1646748950eeb97bae09e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60a7b68d-60", "ovs_interfaceid": "60a7b68d-60a8-4c5b-9d87-976a7cea4af4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:44:2f,bridge_name='br-int',has_traffic_filtering=True,id=60a7b68d-60a8-4c5b-9d87-976a7cea4af4,network=Network(914537bd-569c-44e7-a4ff-7c01056ae14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60a7b68d-60') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG os_vif [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:44:2f,bridge_name='br-int',has_traffic_filtering=True,id=60a7b68d-60a8-4c5b-9d87-976a7cea4af4,network=Network(914537bd-569c-44e7-a4ff-7c01056ae14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60a7b68d-60') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60a7b68d-60, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9feded4-dc67-4901-8f37-e4464d6d9ef2) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:23 user nova-compute[75100]: INFO os_vif [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:44:2f,bridge_name='br-int',has_traffic_filtering=True,id=60a7b68d-60a8-4c5b-9d87-976a7cea4af4,network=Network(914537bd-569c-44e7-a4ff-7c01056ae14f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60a7b68d-60')
Nov 13 17:45:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Deleting instance files /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f_del
Nov 13 17:45:23 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Deletion of /opt/stack/data/nova/instances/6415b849-7cef-4ea4-83f8-ccc5fb2d052f_del complete
Nov 13 17:45:23 user nova-compute[75100]: INFO nova.compute.manager [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 13 17:45:23 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:45:23 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:45:24 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:45:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-2dbb6254-e547-476e-a696-79f6ac94749a req-c4a2d38b-6da1-4794-9a0b-3591ce61d274 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Received event network-vif-deleted-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:24 user nova-compute[75100]: INFO nova.compute.manager [req-2dbb6254-e547-476e-a696-79f6ac94749a req-c4a2d38b-6da1-4794-9a0b-3591ce61d274 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Neutron deleted interface 60a7b68d-60a8-4c5b-9d87-976a7cea4af4; detaching it from the instance and deleting it from the info cache
Nov 13 17:45:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-2dbb6254-e547-476e-a696-79f6ac94749a req-c4a2d38b-6da1-4794-9a0b-3591ce61d274 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:45:24 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Took 0.87 seconds to deallocate network for instance.
Nov 13 17:45:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-2dbb6254-e547-476e-a696-79f6ac94749a req-c4a2d38b-6da1-4794-9a0b-3591ce61d274 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Detach interface failed, port_id=60a7b68d-60a8-4c5b-9d87-976a7cea4af4, reason: Instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:45:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:24 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:45:24 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:45:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:24 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Deleted allocations for instance 6415b849-7cef-4ea4-83f8-ccc5fb2d052f
Nov 13 17:45:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-62a498b8-5dd2-47b2-a809-18f20861e8e7 tempest-TestServerVolumeAttachmentScenario-1234263029 tempest-TestServerVolumeAttachmentScenario-1234263029-project-member] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.089s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-af3eeada-81ed-4a94-b013-d131b9c73509 req-45cf245d-389e-4a5f-9749-a2cfd3e91290 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Received event network-vif-plugged-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af3eeada-81ed-4a94-b013-d131b9c73509 req-45cf245d-389e-4a5f-9749-a2cfd3e91290 service nova] Acquiring lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af3eeada-81ed-4a94-b013-d131b9c73509 req-45cf245d-389e-4a5f-9749-a2cfd3e91290 service nova] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-af3eeada-81ed-4a94-b013-d131b9c73509 req-45cf245d-389e-4a5f-9749-a2cfd3e91290 service nova] Lock "6415b849-7cef-4ea4-83f8-ccc5fb2d052f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-af3eeada-81ed-4a94-b013-d131b9c73509 req-45cf245d-389e-4a5f-9749-a2cfd3e91290 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] No waiting events found dispatching network-vif-plugged-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:45:25 user nova-compute[75100]: WARNING nova.compute.manager [req-af3eeada-81ed-4a94-b013-d131b9c73509 req-45cf245d-389e-4a5f-9749-a2cfd3e91290 service nova] [instance: 6415b849-7cef-4ea4-83f8-ccc5fb2d052f] Received unexpected event network-vif-plugged-60a7b68d-60a8-4c5b-9d87-976a7cea4af4 for instance with vm_state deleted and task_state None.
Nov 13 17:45:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-b3ef607d-9b32-426b-b300-8b2ddc1edf64 req-5185c448-8434-46d3-b96a-7df32484019f service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received event network-changed-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-b3ef607d-9b32-426b-b300-8b2ddc1edf64 req-5185c448-8434-46d3-b96a-7df32484019f service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Refreshing instance network info cache due to event network-changed-dec33d9c-57c8-41a4-a519-c1b6712c80f6. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b3ef607d-9b32-426b-b300-8b2ddc1edf64 req-5185c448-8434-46d3-b96a-7df32484019f service nova] Acquiring lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b3ef607d-9b32-426b-b300-8b2ddc1edf64 req-5185c448-8434-46d3-b96a-7df32484019f service nova] Acquired lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-b3ef607d-9b32-426b-b300-8b2ddc1edf64 req-5185c448-8434-46d3-b96a-7df32484019f service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Refreshing network info cache for port dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:33 user nova-compute[75100]: INFO nova.compute.manager [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Terminating instance
Nov 13 17:45:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-b3ef607d-9b32-426b-b300-8b2ddc1edf64 req-5185c448-8434-46d3-b96a-7df32484019f service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Updated VIF entry in instance network info cache for port dec33d9c-57c8-41a4-a519-c1b6712c80f6. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-b3ef607d-9b32-426b-b300-8b2ddc1edf64 req-5185c448-8434-46d3-b96a-7df32484019f service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Updating instance_info_cache with network_info: [{"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:45:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-b3ef607d-9b32-426b-b300-8b2ddc1edf64 req-5185c448-8434-46d3-b96a-7df32484019f service nova] Releasing lock "refresh_cache-f589271c-7e6c-4352-8b85-8a7aca61dc7f" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Instance destroyed successfully.
Nov 13 17:45:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lazy-loading 'resources' on Instance uuid f589271c-7e6c-4352-8b85-8a7aca61dc7f {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1889027385',display_name='tempest-TestStampPattern-server-1889027385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1889027385',id=39,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrOJF+I3W+VJrAHWGtN2MBJOMvEMODLQzn5ApWc/HW7iPWY+6/PHmwlDqsSJlNM55EzzJ9KtnrIwnuukCA4w5GI3FhgGrJxENswyXMhu8EweYbo1/3V9R/qP3i6bwmSqA==',key_name='tempest-TestStampPattern-1218817336',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='beeb8e861865462e80ed3a213a09f8b1',ramdisk_id='',reservation_id='r-okayg1of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-317206420',owner_user_name='tempest-TestStampPattern-317206420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:41:47Z,user_data=None,user_id='bc9396967a5f4666b8d1d4df794b31aa',uuid=f589271c-7e6c-4352-8b85-8a7aca61dc7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Converting VIF {"id": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "address": "fa:16:3e:e1:46:73", "network": {"id": "e73f7e83-facd-4dbf-ba05-ae9fa6601b18", "bridge": "br-int", "label": "tempest-TestStampPattern-1406220294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "beeb8e861865462e80ed3a213a09f8b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec33d9c-57", "ovs_interfaceid": "dec33d9c-57c8-41a4-a519-c1b6712c80f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:46:73,bridge_name='br-int',has_traffic_filtering=True,id=dec33d9c-57c8-41a4-a519-c1b6712c80f6,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec33d9c-57') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG os_vif [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:46:73,bridge_name='br-int',has_traffic_filtering=True,id=dec33d9c-57c8-41a4-a519-c1b6712c80f6,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec33d9c-57') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdec33d9c-57, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9e754d0-3900-4799-a07e-ff938d5dedbf) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:45:34 user nova-compute[75100]: INFO os_vif [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:46:73,bridge_name='br-int',has_traffic_filtering=True,id=dec33d9c-57c8-41a4-a519-c1b6712c80f6,network=Network(e73f7e83-facd-4dbf-ba05-ae9fa6601b18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec33d9c-57')
Nov 13 17:45:34 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Deleting instance files /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f_del
Nov 13 17:45:34 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Deletion of /opt/stack/data/nova/instances/f589271c-7e6c-4352-8b85-8a7aca61dc7f_del complete
Nov 13 17:45:34 user nova-compute[75100]: INFO nova.compute.manager [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 17:45:34 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:45:34 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Took 0.53 seconds to deallocate network for instance.
Nov 13 17:45:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-bd6ea419-944d-4c8f-81f4-ef16edcd2fb0 req-bd65e160-6e3b-4f15-ae55-f5c31a9f6888 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received event network-vif-deleted-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:45:34 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:35 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Deleted allocations for instance f589271c-7e6c-4352-8b85-8a7aca61dc7f
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9ee24c4d-d10a-42bf-b052-dab89456a7ed tempest-TestStampPattern-317206420 tempest-TestStampPattern-317206420-project-member] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.765s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received event network-vif-unplugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] No waiting events found dispatching network-vif-unplugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:45:35 user nova-compute[75100]: WARNING nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received unexpected event network-vif-unplugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 for instance with vm_state deleted and task_state None.
Nov 13 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received event network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] No waiting events found dispatching network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:45:35 user nova-compute[75100]: WARNING nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received unexpected event network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 for instance with vm_state deleted and task_state None.
Nov 13 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received event network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] No waiting events found dispatching network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:45:35 user nova-compute[75100]: WARNING nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received unexpected event network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 for instance with vm_state deleted and task_state None.
Nov 13 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received event network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] No waiting events found dispatching network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:45:35 user nova-compute[75100]: WARNING nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received unexpected event network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 for instance with vm_state deleted and task_state None.
Nov 13 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received event network-vif-unplugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] No waiting events found dispatching network-vif-unplugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:45:35 user nova-compute[75100]: WARNING nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received unexpected event network-vif-unplugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 for instance with vm_state deleted and task_state None.
Nov 13 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received event network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Acquiring lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] Lock "f589271c-7e6c-4352-8b85-8a7aca61dc7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] No waiting events found dispatching network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:45:35 user nova-compute[75100]: WARNING nova.compute.manager [req-1e72d354-9ec5-4e87-bf30-f5aca643d9e5 req-6739f5b2-bfe9-4353-b458-18b25dca0de5 service nova] [instance: f589271c-7e6c-4352-8b85-8a7aca61dc7f] Received unexpected event network-vif-plugged-dec33d9c-57c8-41a4-a519-c1b6712c80f6 for instance with vm_state deleted and task_state None.
Nov 13 17:45:36 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:45:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 17:45:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 17:45:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:45:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-f0bf103e-23eb-486a-a5df-9f3e66d4d076" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-f0bf103e-23eb-486a-a5df-9f3e66d4d076" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid f0bf103e-23eb-486a-a5df-9f3e66d4d076 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Updating instance_info_cache with network_info: [{"id": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "address": "fa:16:3e:e1:f3:58", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5bea88-fe", "ovs_interfaceid": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-f0bf103e-23eb-486a-a5df-9f3e66d4d076" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:40 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-5a100034-4b5e-446a-b9e4-f969185df7be req-8d436d67-211d-4749-9cdb-5ebb8a51ad08 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Received event network-changed-edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-5a100034-4b5e-446a-b9e4-f969185df7be req-8d436d67-211d-4749-9cdb-5ebb8a51ad08 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Refreshing instance network info cache due to event network-changed-edf99438-4f5d-4f9e-b4bf-0b43cf706edc. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5a100034-4b5e-446a-b9e4-f969185df7be req-8d436d67-211d-4749-9cdb-5ebb8a51ad08 service nova] Acquiring lock "refresh_cache-fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5a100034-4b5e-446a-b9e4-f969185df7be req-8d436d67-211d-4749-9cdb-5ebb8a51ad08 service nova] Acquired lock "refresh_cache-fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG nova.network.neutron [req-5a100034-4b5e-446a-b9e4-f969185df7be req-8d436d67-211d-4749-9cdb-5ebb8a51ad08 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Refreshing network info cache for port edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG nova.network.neutron [req-5a100034-4b5e-446a-b9e4-f969185df7be req-8d436d67-211d-4749-9cdb-5ebb8a51ad08 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Updated VIF entry in instance network info cache for port edf99438-4f5d-4f9e-b4bf-0b43cf706edc. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG nova.network.neutron [req-5a100034-4b5e-446a-b9e4-f969185df7be req-8d436d67-211d-4749-9cdb-5ebb8a51ad08 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Updating instance_info_cache with network_info: [{"id": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "address": "fa:16:3e:fe:0a:b3", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf99438-4f", "ovs_interfaceid": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5a100034-4b5e-446a-b9e4-f969185df7be req-8d436d67-211d-4749-9cdb-5ebb8a51ad08 service nova] Releasing lock "refresh_cache-fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:41 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:42 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:45:42 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:45:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8620MB free_disk=25.102481842041016GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'flavor' on Instance uuid fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance f0bf103e-23eb-486a-a5df-9f3e66d4d076 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:42 user nova-compute[75100]: INFO nova.compute.manager [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Attaching volume 4dddabed-b329-47f7-bb3c-c32e0125b568 to /dev/vdb
Nov 13 17:45:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing inventories for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating ProviderTree inventory for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating inventory in ProviderTree for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG os_brick.utils [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing aggregate associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:42 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b45e302-1ffc-453a-97c6-4b4abdea7385]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing trait associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3103b86d-a6df-443d-a1d8-1e8f219a4b71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c05b203-293b-4304-b587-dfc8a2adbd40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b660a7-fdc1-4c1f-8a66-6810105aa62f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:45:43 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17665ab-78c8-47c4-b385-d450ab5200af]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG os_brick.utils [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Updating existing volume attachment record: 4bc7df3b-553a-485e-915e-914b1d5e843f {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:45:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:45:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:45:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMbdDKJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:45:47 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:45:47 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:45:47 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8c9f3b-7a86-4bcb-83af-0e3ec2f8bfc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:45:47 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[df57edc6-c5be-4da4-a187-5f65dad31af4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568] added
Nov 13 17:45:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40a67fd-9cfc-4575-8379-b2efe31fb45b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0061d265-70f2-4d28-87a5-891d3afb520a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AMbdDKJQ {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AMbdDKJQ" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3745448-8401-4645-b555-1ef1d145fe6e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AMbdDKJQ'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b422f89b-4e5c-4727-934e-1391beaf0abe]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b08fb6d-c976-4ee1-a249-2513373156d8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:45:47 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:45:47 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:45:47 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 17:45:47 user nova-compute[75100]: 
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce7f431-902f-4aac-a734-04031c143b68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568, portal: 172.16.0.220,3260]
Nov 13 17:45:47 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568, portal: 172.16.0.220,3260] successful.
Nov 13 17:45:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdaffef-ced7-4fa0-b25b-1480ba8b87d2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4f8090-decd-4302-966c-35769ba7c24a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 (non-flash)
Nov 13 17:45:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 (non-flash)
Nov 13 17:45:47 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd602941-4cab-4321-b7d9-e4d4cbaf26ad]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMbdDKJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:45:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:45:48 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23762656333653137', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:45:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762656333653137', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:45:48 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'flavor' on Instance uuid fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:45:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:45:48 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:45:48 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:45:48 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:45:48 user nova-compute[75100]:   <serial>4dddabed-b329-47f7-bb3c-c32e0125b568</serial>
Nov 13 17:45:48 user nova-compute[75100]: </disk>
Nov 13 17:45:48 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:45:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:45:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:45:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No VIF found with MAC fa:16:3e:fe:0a:b3, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:45:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ae948c94-c12e-431f-992e-600a1d0b2cb9 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.035s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:49 user nova-compute[75100]: INFO nova.compute.manager [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Detaching volume 4dddabed-b329-47f7-bb3c-c32e0125b568
Nov 13 17:45:49 user nova-compute[75100]: INFO nova.virt.block_device [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Attempting to driver detach volume 4dddabed-b329-47f7-bb3c-c32e0125b568 from mountpoint /dev/vdb
Nov 13 17:45:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Attempting to detach device vdb from instance fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:45:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:45:49 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:45:49 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:45:49 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:45:49 user nova-compute[75100]:   <serial>4dddabed-b329-47f7-bb3c-c32e0125b568</serial>
Nov 13 17:45:49 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:45:49 user nova-compute[75100]: </disk>
Nov 13 17:45:49 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:45:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully detached device vdb from instance fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 from the persistent domain config.
Nov 13 17:45:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:45:49 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:45:49 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:45:49 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:45:49 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:45:49 user nova-compute[75100]:   <serial>4dddabed-b329-47f7-bb3c-c32e0125b568</serial>
Nov 13 17:45:49 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:45:49 user nova-compute[75100]: </disk>
Nov 13 17:45:49 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:45:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:51 user nova-compute[75100]: INFO nova.compute.manager [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Terminating instance
Nov 13 17:45:51 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-6c9a78a1-422a-44a2-81bc-ba7077816b66 req-8e3438bc-66d0-479f-88d7-b2a1a9714a66 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-vif-unplugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6c9a78a1-422a-44a2-81bc-ba7077816b66 req-8e3438bc-66d0-479f-88d7-b2a1a9714a66 service nova] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6c9a78a1-422a-44a2-81bc-ba7077816b66 req-8e3438bc-66d0-479f-88d7-b2a1a9714a66 service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-6c9a78a1-422a-44a2-81bc-ba7077816b66 req-8e3438bc-66d0-479f-88d7-b2a1a9714a66 service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-6c9a78a1-422a-44a2-81bc-ba7077816b66 req-8e3438bc-66d0-479f-88d7-b2a1a9714a66 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] No waiting events found dispatching network-vif-unplugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:45:51 user nova-compute[75100]: DEBUG nova.compute.manager [req-6c9a78a1-422a-44a2-81bc-ba7077816b66 req-8e3438bc-66d0-479f-88d7-b2a1a9714a66 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-vif-unplugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:45:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Instance destroyed successfully.
Nov 13 17:45:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'resources' on Instance uuid 6a32f8b7-2e32-42a7-b600-fc88bcc577fd {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2002205144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2002205144',id=42,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw5/1O+7fCYlXt2eQaRgEJLZ4+j1NCpqqWKg3tOzqMfKiv6ItQM1MSBVha+jLGvqqFyBNuibAfc5etB/s5ejgZZQK5kstmOid0WnRHZWrwqF2GYhsMRpGVp8JeJfpfkZQ==',key_name='tempest-keypair-457334197',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:43:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db67a12bfc7f48b380175a6871012f25',ramdisk_id='',reservation_id='r-senzr9dj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1414200693',owner_user_name='tempest-AttachVolumeShelveTestJSON-1414200693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:43:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54440f660c64141ad91285ddef65ca9',uuid=6a32f8b7-2e32-42a7-b600-fc88bcc577fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converting VIF {"id": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "address": "fa:16:3e:11:8d:15", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8fbe0d9f-51", "ovs_interfaceid": "8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG os_vif [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8fbe0d9f-51, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ce01038-cfd4-459e-8dcd-475c176dc7d1) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:45:52 user nova-compute[75100]: INFO os_vif [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:8d:15,bridge_name='br-int',has_traffic_filtering=True,id=8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8fbe0d9f-51')
Nov 13 17:45:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Deleting instance files /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd_del
Nov 13 17:45:52 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Deletion of /opt/stack/data/nova/instances/6a32f8b7-2e32-42a7-b600-fc88bcc577fd_del complete
Nov 13 17:45:52 user nova-compute[75100]: INFO nova.compute.manager [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 17:45:52 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:45:52 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:45:53 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:45:53 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Took 0.98 seconds to deallocate network for instance.
Nov 13 17:45:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:53 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:45:53 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:45:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:53 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Deleted allocations for instance 6a32f8b7-2e32-42a7-b600-fc88bcc577fd
Nov 13 17:45:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2d2d590-99a5-4bfd-93ff-742ba6aa149b tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.213s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-60b59985-28ca-4e09-9c10-6ad15eaf7926 req-97695868-3068-4e44-8b7a-626b8db97239 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-60b59985-28ca-4e09-9c10-6ad15eaf7926 req-97695868-3068-4e44-8b7a-626b8db97239 service nova] Acquiring lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:45:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-60b59985-28ca-4e09-9c10-6ad15eaf7926 req-97695868-3068-4e44-8b7a-626b8db97239 service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:45:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-60b59985-28ca-4e09-9c10-6ad15eaf7926 req-97695868-3068-4e44-8b7a-626b8db97239 service nova] Lock "6a32f8b7-2e32-42a7-b600-fc88bcc577fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:45:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-60b59985-28ca-4e09-9c10-6ad15eaf7926 req-97695868-3068-4e44-8b7a-626b8db97239 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] No waiting events found dispatching network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:45:53 user nova-compute[75100]: WARNING nova.compute.manager [req-60b59985-28ca-4e09-9c10-6ad15eaf7926 req-97695868-3068-4e44-8b7a-626b8db97239 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received unexpected event network-vif-plugged-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac for instance with vm_state deleted and task_state None.
Nov 13 17:45:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-60b59985-28ca-4e09-9c10-6ad15eaf7926 req-97695868-3068-4e44-8b7a-626b8db97239 service nova] [instance: 6a32f8b7-2e32-42a7-b600-fc88bcc577fd] Received event network-vif-deleted-8fbe0d9f-5190-45f4-9d3a-3ec8ce51d7ac {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:45:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:45:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 17:46:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:03 user nova-compute[75100]: INFO nova.compute.manager [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Terminating instance
Nov 13 17:46:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-54cfc00c-0b2a-4be1-89e3-dfc714aa6f83 req-c073234a-123f-482d-bff0-716fa8adc163 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Received event network-vif-unplugged-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-54cfc00c-0b2a-4be1-89e3-dfc714aa6f83 req-c073234a-123f-482d-bff0-716fa8adc163 service nova] Acquiring lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-54cfc00c-0b2a-4be1-89e3-dfc714aa6f83 req-c073234a-123f-482d-bff0-716fa8adc163 service nova] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-54cfc00c-0b2a-4be1-89e3-dfc714aa6f83 req-c073234a-123f-482d-bff0-716fa8adc163 service nova] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-54cfc00c-0b2a-4be1-89e3-dfc714aa6f83 req-c073234a-123f-482d-bff0-716fa8adc163 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] No waiting events found dispatching network-vif-unplugged-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-54cfc00c-0b2a-4be1-89e3-dfc714aa6f83 req-c073234a-123f-482d-bff0-716fa8adc163 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Received event network-vif-unplugged-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:46:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Instance destroyed successfully.
Nov 13 17:46:03 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lazy-loading 'resources' on Instance uuid f0bf103e-23eb-486a-a5df-9f3e66d4d076 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:37:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1869687129',display_name='tempest-ServersNegativeTestJSON-server-1869687129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1869687129',id=38,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:37:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='047cedafb8344129a644233034fef4f4',ramdisk_id='',reservation_id='r-zd0a9bbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1990231420',owner_user_name='tempest-ServersNegativeTestJSON-1990231420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:37:33Z,user_data=None,user_id='380d78e868b44598aa311630ce34e0d1',uuid=f0bf103e-23eb-486a-a5df-9f3e66d4d076,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "address": "fa:16:3e:e1:f3:58", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5bea88-fe", "ovs_interfaceid": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Converting VIF {"id": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "address": "fa:16:3e:e1:f3:58", "network": {"id": "450aadfd-cce3-40ec-b394-91bc2a3fa451", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1544005863-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "047cedafb8344129a644233034fef4f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5bea88-fe", "ovs_interfaceid": "fd5bea88-fef0-4963-bb8f-4aaf5be02ef5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=fd5bea88-fef0-4963-bb8f-4aaf5be02ef5,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5bea88-fe') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG os_vif [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=fd5bea88-fef0-4963-bb8f-4aaf5be02ef5,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5bea88-fe') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd5bea88-fe, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c64d12aa-294d-4374-9542-a13faf5ca0a1) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:46:03 user nova-compute[75100]: INFO os_vif [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:f3:58,bridge_name='br-int',has_traffic_filtering=True,id=fd5bea88-fef0-4963-bb8f-4aaf5be02ef5,network=Network(450aadfd-cce3-40ec-b394-91bc2a3fa451),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5bea88-fe')
Nov 13 17:46:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Deleting instance files /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076_del
Nov 13 17:46:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Deletion of /opt/stack/data/nova/instances/f0bf103e-23eb-486a-a5df-9f3e66d4d076_del complete
Nov 13 17:46:04 user nova-compute[75100]: INFO nova.compute.manager [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 13 17:46:04 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:46:04 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:46:04 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:46:04 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:46:04 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Took 0.46 seconds to deallocate network for instance.
Nov 13 17:46:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-60e31e1e-0604-4e4e-9d44-1cd0b6718d91 req-c5e25115-e9bd-4f47-aac3-58b2b3e3227c service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Received event network-vif-deleted-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:46:04 user nova-compute[75100]: INFO nova.compute.manager [req-60e31e1e-0604-4e4e-9d44-1cd0b6718d91 req-c5e25115-e9bd-4f47-aac3-58b2b3e3227c service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Neutron deleted interface fd5bea88-fef0-4963-bb8f-4aaf5be02ef5; detaching it from the instance and deleting it from the info cache
Nov 13 17:46:04 user nova-compute[75100]: DEBUG nova.network.neutron [req-60e31e1e-0604-4e4e-9d44-1cd0b6718d91 req-c5e25115-e9bd-4f47-aac3-58b2b3e3227c service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:46:04 user nova-compute[75100]: DEBUG nova.compute.manager [req-60e31e1e-0604-4e4e-9d44-1cd0b6718d91 req-c5e25115-e9bd-4f47-aac3-58b2b3e3227c service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Detach interface failed, port_id=fd5bea88-fef0-4963-bb8f-4aaf5be02ef5, reason: Instance f0bf103e-23eb-486a-a5df-9f3e66d4d076 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:46:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:04 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:46:04 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:46:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:04 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Deleted allocations for instance f0bf103e-23eb-486a-a5df-9f3e66d4d076
Nov 13 17:46:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b0decbe6-45ab-4d5f-b47d-b88afef90440 tempest-ServersNegativeTestJSON-1990231420 tempest-ServersNegativeTestJSON-1990231420-project-member] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.441s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-30cf8432-503c-4cfc-bcc8-a1664a4dbfa3 req-71cb3a96-d5f0-47a9-a4ff-7e2cc211c276 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Received event network-vif-plugged-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:46:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-30cf8432-503c-4cfc-bcc8-a1664a4dbfa3 req-71cb3a96-d5f0-47a9-a4ff-7e2cc211c276 service nova] Acquiring lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-30cf8432-503c-4cfc-bcc8-a1664a4dbfa3 req-71cb3a96-d5f0-47a9-a4ff-7e2cc211c276 service nova] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-30cf8432-503c-4cfc-bcc8-a1664a4dbfa3 req-71cb3a96-d5f0-47a9-a4ff-7e2cc211c276 service nova] Lock "f0bf103e-23eb-486a-a5df-9f3e66d4d076-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-30cf8432-503c-4cfc-bcc8-a1664a4dbfa3 req-71cb3a96-d5f0-47a9-a4ff-7e2cc211c276 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] No waiting events found dispatching network-vif-plugged-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:46:05 user nova-compute[75100]: WARNING nova.compute.manager [req-30cf8432-503c-4cfc-bcc8-a1664a4dbfa3 req-71cb3a96-d5f0-47a9-a4ff-7e2cc211c276 service nova] [instance: f0bf103e-23eb-486a-a5df-9f3e66d4d076] Received unexpected event network-vif-plugged-fd5bea88-fef0-4963-bb8f-4aaf5be02ef5 for instance with vm_state deleted and task_state None.
Nov 13 17:46:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:10 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 is timed out.
Nov 13 17:46:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully detached device vdb from instance fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 from the live domain config.
Nov 13 17:46:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AMbdDKJQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:46:10 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[42348ad0-4f63-430a-817b-b7b0a72fc33f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:46:10 user nova-compute[75100]: No targets found.
Nov 13 17:46:10 user nova-compute[75100]: iSNS:
Nov 13 17:46:10 user nova-compute[75100]: No targets found.
Nov 13 17:46:10 user nova-compute[75100]: STATIC:
Nov 13 17:46:10 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568
Nov 13 17:46:10 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:46:10 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:46:10 user nova-compute[75100]: FIRMWARE:
Nov 13 17:46:10 user nova-compute[75100]: No targets found.
Nov 13 17:46:10 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:46:10 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:46:10 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[93659cc7-242f-4b81-b853-bc7398e217d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05ef580-4465-4bb6-acae-1fb348d370ce]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 (non-flash)
Nov 13 17:46:10 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 (non-flash)
Nov 13 17:46:10 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38f5fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ba1e29-a234-48ed-abc0-026be0e20098]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6128d46f-101c-4ffb-b033-08ec4ba2615b]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[597c2102-3292-4016-bfa4-2bcb6946e7a2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba4f2ec-d695-4ecf-9ac9-1f3906025219]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f57678-2444-4064-8c49-48c58140ade3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c10f6ec-a1d8-4566-81ff-2c75e4438b50]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568, portal: 172.16.0.220,3260]
Nov 13 17:46:10 user nova-compute[75100]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568, portal: 172.16.0.220,3260] successful.
Nov 13 17:46:10 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dddabed-b329-47f7-bb3c-c32e0125b568 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2790ae-e2bd-423a-8974-623086b2fcde]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] <== disconnect_volume: return (297ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:46:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:11 user nova-compute[75100]: DEBUG nova.objects.instance [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'flavor' on Instance uuid fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:46:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-211bd030-d963-4e79-9695-bd9307069766 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.656s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:38 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:40 user nova-compute[75100]: INFO nova.compute.manager [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Terminating instance
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-d5f043f5-2f26-4978-b6d8-5967e9fdd4df req-b921117a-baca-4e54-bd7e-e0b55db74ef4 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Received event network-vif-unplugged-edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d5f043f5-2f26-4978-b6d8-5967e9fdd4df req-b921117a-baca-4e54-bd7e-e0b55db74ef4 service nova] Acquiring lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d5f043f5-2f26-4978-b6d8-5967e9fdd4df req-b921117a-baca-4e54-bd7e-e0b55db74ef4 service nova] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-d5f043f5-2f26-4978-b6d8-5967e9fdd4df req-b921117a-baca-4e54-bd7e-e0b55db74ef4 service nova] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-d5f043f5-2f26-4978-b6d8-5967e9fdd4df req-b921117a-baca-4e54-bd7e-e0b55db74ef4 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] No waiting events found dispatching network-vif-unplugged-edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.compute.manager [req-d5f043f5-2f26-4978-b6d8-5967e9fdd4df req-b921117a-baca-4e54-bd7e-e0b55db74ef4 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Received event network-vif-unplugged-edf99438-4f5d-4f9e-b4bf-0b43cf706edc for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Skipping network cache update for instance because it is being deleted. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Instance destroyed successfully.
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'resources' on Instance uuid fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:43:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-670976538',display_name='tempest-AttachVolumeNegativeTest-server-670976538',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-670976538',id=45,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIwyeUaUW79TbkFPsNW712asprzHeIjJqhyHSiCtb8vmIjldf02Jiynwdxp/TR0oiGIFnN6Ht7JXHSoXe7bZnWOWU2BNrrACxF5O6yBE4raKMLejzwCQyR5sIJkHYTnfKw==',key_name='tempest-keypair-1498095666',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:43:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6352bffe5fa144f996e2ba07f69f4ee4',ramdisk_id='',reservation_id='r-ap7ftpxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2126330685',owner_user_name='tempest-AttachVolumeNegativeTest-2126330685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:43:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fde156049464deba4b3a3125712baa9',uuid=fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "address": "fa:16:3e:fe:0a:b3", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf99438-4f", "ovs_interfaceid": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converting VIF {"id": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "address": "fa:16:3e:fe:0a:b3", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedf99438-4f", "ovs_interfaceid": "edf99438-4f5d-4f9e-b4bf-0b43cf706edc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:0a:b3,bridge_name='br-int',has_traffic_filtering=True,id=edf99438-4f5d-4f9e-b4bf-0b43cf706edc,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf99438-4f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG os_vif [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:0a:b3,bridge_name='br-int',has_traffic_filtering=True,id=edf99438-4f5d-4f9e-b4bf-0b43cf706edc,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf99438-4f') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedf99438-4f, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=181e5b7d-a6e2-4cd8-b9ef-2865e7b691f6) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:46:40 user nova-compute[75100]: INFO os_vif [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:0a:b3,bridge_name='br-int',has_traffic_filtering=True,id=edf99438-4f5d-4f9e-b4bf-0b43cf706edc,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedf99438-4f')
Nov 13 17:46:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Deleting instance files /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58_del
Nov 13 17:46:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Deletion of /opt/stack/data/nova/instances/fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58_del complete
Nov 13 17:46:40 user nova-compute[75100]: INFO nova.compute.manager [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 17:46:40 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:46:40 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:46:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:41 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:46:41 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Took 0.63 seconds to deallocate network for instance.
Nov 13 17:46:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-823f82e2-c7c3-408d-ad76-3565cb2fb854 req-891ffc3e-75c2-4b95-b202-4dd21f67e575 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Received event network-vif-deleted-edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:46:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:41 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:46:41 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:46:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:41 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Deleted allocations for instance fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58
Nov 13 17:46:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d975bb22-6d4f-464b-91a8-31de4e2e723e tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.799s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-76797f66-3337-4ac5-9030-88ba53f4a77f req-929844d5-c466-4a12-b6ec-c8d39a241264 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Received event network-vif-plugged-edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-76797f66-3337-4ac5-9030-88ba53f4a77f req-929844d5-c466-4a12-b6ec-c8d39a241264 service nova] Acquiring lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-76797f66-3337-4ac5-9030-88ba53f4a77f req-929844d5-c466-4a12-b6ec-c8d39a241264 service nova] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-76797f66-3337-4ac5-9030-88ba53f4a77f req-929844d5-c466-4a12-b6ec-c8d39a241264 service nova] Lock "fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG nova.compute.manager [req-76797f66-3337-4ac5-9030-88ba53f4a77f req-929844d5-c466-4a12-b6ec-c8d39a241264 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] No waiting events found dispatching network-vif-plugged-edf99438-4f5d-4f9e-b4bf-0b43cf706edc {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:46:42 user nova-compute[75100]: WARNING nova.compute.manager [req-76797f66-3337-4ac5-9030-88ba53f4a77f req-929844d5-c466-4a12-b6ec-c8d39a241264 service nova] [instance: fb02cfb0-ea4d-4d01-917f-8d9d1f1d9a58] Received unexpected event network-vif-plugged-edf99438-4f5d-4f9e-b4bf-0b43cf706edc for instance with vm_state deleted and task_state None.
Nov 13 17:46:42 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:46:42 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:46:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=9065MB free_disk=25.18279266357422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:46:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:46:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:46:45 user nova-compute[75100]: INFO nova.compute.claims [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Claim successful on node user
Nov 13 17:46:45 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:46:45 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:46:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG nova.policy [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c54440f660c64141ad91285ddef65ca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db67a12bfc7f48b380175a6871012f25', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:46:45 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Creating image(s)
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "/opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "/opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "/opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk 1073741824" returned: 0 in 0.054s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Successfully created port: d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Cannot resize image /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Ensure instance console log exists: /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Successfully updated port: d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquired lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-caeb3fff-74da-47a2-bc88-64dbd57d33f1 req-bfd6490e-a9fa-4337-8689-b443e5afad9b service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-changed-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.compute.manager [req-caeb3fff-74da-47a2-bc88-64dbd57d33f1 req-bfd6490e-a9fa-4337-8689-b443e5afad9b service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Refreshing instance network info cache due to event network-changed-d535aaf8-4bce-4fdb-924b-a4fbb91d204b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-caeb3fff-74da-47a2-bc88-64dbd57d33f1 req-bfd6490e-a9fa-4337-8689-b443e5afad9b service nova] Acquiring lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.network.neutron [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updating instance_info_cache with network_info: [{"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Releasing lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Instance network_info: |[{"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-caeb3fff-74da-47a2-bc88-64dbd57d33f1 req-bfd6490e-a9fa-4337-8689-b443e5afad9b service nova] Acquired lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.network.neutron [req-caeb3fff-74da-47a2-bc88-64dbd57d33f1 req-bfd6490e-a9fa-4337-8689-b443e5afad9b service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Refreshing network info cache for port d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Start _get_guest_xml network_info=[{"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:46:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:46:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2137819338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2137819338',id=46,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvKi8s04o0q2ooK0TBJF2ZO2Wdyk2/m96B9PWdof7c/QR3DTCOboEB2/R6UqnM9GkXYVSP1gUco+D6Np22hZLqeqchxniMB8AiYZoKAUvW73f6HYLMUUI3puDPFNU1uOw==',key_name='tempest-keypair-143936512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db67a12bfc7f48b380175a6871012f25',ramdisk_id='',reservation_id='r-n3ft0jyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1414200693',owner_user_name='tempest-AttachVolumeShelveTestJSON-1414200693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:46:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54440f660c64141ad91285ddef65ca9',uuid=88ac770d-eefa-4c0c-86e7-2d50fd322d28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converting VIF {"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'pci_devices' on Instance uuid 88ac770d-eefa-4c0c-86e7-2d50fd322d28 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:46:46 user nova-compute[75100]:   <uuid>88ac770d-eefa-4c0c-86e7-2d50fd322d28</uuid>
Nov 13 17:46:46 user nova-compute[75100]:   <name>instance-0000002e</name>
Nov 13 17:46:46 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:46:46 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:46:46 user nova-compute[75100]:   <metadata>
Nov 13 17:46:46 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:46:46 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:46:46 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2137819338</nova:name>
Nov 13 17:46:46 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:46:46</nova:creationTime>
Nov 13 17:46:46 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:46:46 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:46:46 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:46:46 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:46:46 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:46:46 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:46:46 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:46:46 user nova-compute[75100]:       <nova:owner>
Nov 13 17:46:46 user nova-compute[75100]:         <nova:user uuid="c54440f660c64141ad91285ddef65ca9">tempest-AttachVolumeShelveTestJSON-1414200693-project-member</nova:user>
Nov 13 17:46:46 user nova-compute[75100]:         <nova:project uuid="db67a12bfc7f48b380175a6871012f25">tempest-AttachVolumeShelveTestJSON-1414200693</nova:project>
Nov 13 17:46:46 user nova-compute[75100]:       </nova:owner>
Nov 13 17:46:46 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:46:46 user nova-compute[75100]:       <nova:ports>
Nov 13 17:46:46 user nova-compute[75100]:         <nova:port uuid="d535aaf8-4bce-4fdb-924b-a4fbb91d204b">
Nov 13 17:46:46 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 17:46:46 user nova-compute[75100]:         </nova:port>
Nov 13 17:46:46 user nova-compute[75100]:       </nova:ports>
Nov 13 17:46:46 user nova-compute[75100]:     </nova:instance>
Nov 13 17:46:46 user nova-compute[75100]:   </metadata>
Nov 13 17:46:46 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:46:46 user nova-compute[75100]:     <system>
Nov 13 17:46:46 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:46:46 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:46:46 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:46:46 user nova-compute[75100]:       <entry name="serial">88ac770d-eefa-4c0c-86e7-2d50fd322d28</entry>
Nov 13 17:46:46 user nova-compute[75100]:       <entry name="uuid">88ac770d-eefa-4c0c-86e7-2d50fd322d28</entry>
Nov 13 17:46:46 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:46:46 user nova-compute[75100]:     </system>
Nov 13 17:46:46 user nova-compute[75100]:   </sysinfo>
Nov 13 17:46:46 user nova-compute[75100]:   <os>
Nov 13 17:46:46 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:46:46 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:46:46 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:46:46 user nova-compute[75100]:   </os>
Nov 13 17:46:46 user nova-compute[75100]:   <features>
Nov 13 17:46:46 user nova-compute[75100]:     <acpi/>
Nov 13 17:46:46 user nova-compute[75100]:     <apic/>
Nov 13 17:46:46 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:46:46 user nova-compute[75100]:   </features>
Nov 13 17:46:46 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:46:46 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:46:46 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:46:46 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:46:46 user nova-compute[75100]:   </clock>
Nov 13 17:46:46 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:46:46 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:46:46 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:46:46 user nova-compute[75100]:   </cpu>
Nov 13 17:46:46 user nova-compute[75100]:   <devices>
Nov 13 17:46:46 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:46:46 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:46:46 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk"/>
Nov 13 17:46:46 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:46:46 user nova-compute[75100]:     </disk>
Nov 13 17:46:46 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:46:46 user nova-compute[75100]:       <mac address="fa:16:3e:b5:32:a1"/>
Nov 13 17:46:46 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:46:46 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:46:46 user nova-compute[75100]:       <target dev="tapd535aaf8-4b"/>
Nov 13 17:46:46 user nova-compute[75100]:     </interface>
Nov 13 17:46:46 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:46:46 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/console.log" append="off"/>
Nov 13 17:46:46 user nova-compute[75100]:     </serial>
Nov 13 17:46:46 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:46:46 user nova-compute[75100]:     <video>
Nov 13 17:46:46 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:46:46 user nova-compute[75100]:     </video>
Nov 13 17:46:46 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:46:46 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:46:46 user nova-compute[75100]:     </rng>
Nov 13 17:46:46 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:46:46 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:46:46 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:46:46 user nova-compute[75100]:     </memballoon>
Nov 13 17:46:46 user nova-compute[75100]:   </devices>
Nov 13 17:46:46 user nova-compute[75100]: </domain>
Nov 13 17:46:46 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2137819338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2137819338',id=46,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvKi8s04o0q2ooK0TBJF2ZO2Wdyk2/m96B9PWdof7c/QR3DTCOboEB2/R6UqnM9GkXYVSP1gUco+D6Np22hZLqeqchxniMB8AiYZoKAUvW73f6HYLMUUI3puDPFNU1uOw==',key_name='tempest-keypair-143936512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db67a12bfc7f48b380175a6871012f25',ramdisk_id='',reservation_id='r-n3ft0jyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1414200693',owner_user_name='tempest-AttachVolumeShelveTestJSON-1414200693-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:46:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54440f660c64141ad91285ddef65ca9',uuid=88ac770d-eefa-4c0c-86e7-2d50fd322d28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converting VIF {"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG os_vif [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbb09b6d-6b33-5c70-b31f-a49c6ed68f6a', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:46:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:46:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd535aaf8-4b, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:46:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd535aaf8-4b, col_values=(('qos', UUID('a9f944bd-1292-4665-9841-f7c3b5739220')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:46:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd535aaf8-4b, col_values=(('external_ids', {'iface-id': 'd535aaf8-4bce-4fdb-924b-a4fbb91d204b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:32:a1', 'vm-uuid': '88ac770d-eefa-4c0c-86e7-2d50fd322d28'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:46:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:46:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:47 user nova-compute[75100]: INFO os_vif [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b')
Nov 13 17:46:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:46:47 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] No VIF found with MAC fa:16:3e:b5:32:a1, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:46:47 user nova-compute[75100]: DEBUG nova.network.neutron [req-caeb3fff-74da-47a2-bc88-64dbd57d33f1 req-bfd6490e-a9fa-4337-8689-b443e5afad9b service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updated VIF entry in instance network info cache for port d535aaf8-4bce-4fdb-924b-a4fbb91d204b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:46:47 user nova-compute[75100]: DEBUG nova.network.neutron [req-caeb3fff-74da-47a2-bc88-64dbd57d33f1 req-bfd6490e-a9fa-4337-8689-b443e5afad9b service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updating instance_info_cache with network_info: [{"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:46:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-caeb3fff-74da-47a2-bc88-64dbd57d33f1 req-bfd6490e-a9fa-4337-8689-b443e5afad9b service nova] Releasing lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:46:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:46:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-edfbb126-7385-49fd-877d-be57053c62dd req-9df927ee-0205-411b-8498-db7af35be4fc service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:46:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-edfbb126-7385-49fd-877d-be57053c62dd req-9df927ee-0205-411b-8498-db7af35be4fc service nova] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-edfbb126-7385-49fd-877d-be57053c62dd req-9df927ee-0205-411b-8498-db7af35be4fc service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-edfbb126-7385-49fd-877d-be57053c62dd req-9df927ee-0205-411b-8498-db7af35be4fc service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-edfbb126-7385-49fd-877d-be57053c62dd req-9df927ee-0205-411b-8498-db7af35be4fc service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] No waiting events found dispatching network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:46:48 user nova-compute[75100]: WARNING nova.compute.manager [req-edfbb126-7385-49fd-877d-be57053c62dd req-9df927ee-0205-411b-8498-db7af35be4fc service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received unexpected event network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b for instance with vm_state building and task_state spawning.
Nov 13 17:46:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:46:50 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Instance spawned successfully.
Nov 13 17:46:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:46:50 user nova-compute[75100]: INFO nova.compute.manager [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 13 17:46:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-3d0dcd14-6cdb-42e9-a113-773b96e20277 req-65bf50ce-ea3f-4161-a986-d754a0f98faa service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3d0dcd14-6cdb-42e9-a113-773b96e20277 req-65bf50ce-ea3f-4161-a986-d754a0f98faa service nova] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3d0dcd14-6cdb-42e9-a113-773b96e20277 req-65bf50ce-ea3f-4161-a986-d754a0f98faa service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-3d0dcd14-6cdb-42e9-a113-773b96e20277 req-65bf50ce-ea3f-4161-a986-d754a0f98faa service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-3d0dcd14-6cdb-42e9-a113-773b96e20277 req-65bf50ce-ea3f-4161-a986-d754a0f98faa service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] No waiting events found dispatching network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:46:50 user nova-compute[75100]: WARNING nova.compute.manager [req-3d0dcd14-6cdb-42e9-a113-773b96e20277 req-65bf50ce-ea3f-4161-a986-d754a0f98faa service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received unexpected event network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b for instance with vm_state building and task_state spawning.
Nov 13 17:46:50 user nova-compute[75100]: INFO nova.compute.manager [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Took 5.57 seconds to build instance.
Nov 13 17:46:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b3ab463f-488e-404b-b5c1-f0f3e6283da5 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.671s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:46:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:46:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:47:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:47:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:47:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:47:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:47:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "165155e1-d159-4320-b12f-51dfb6e3e937" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "165155e1-d159-4320-b12f-51dfb6e3e937" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:47:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:33 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:47:33 user nova-compute[75100]: INFO nova.compute.claims [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Claim successful on node user
Nov 13 17:47:33 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:47:33 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:47:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:47:33 user nova-compute[75100]: DEBUG nova.compute.manager [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:47:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:47:34 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:47:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG nova.policy [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fde156049464deba4b3a3125712baa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6352bffe5fa144f996e2ba07f69f4ee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:47:34 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Creating image(s)
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "/opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "/opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "/opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk 1073741824" returned: 0 in 0.056s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.190s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Checking if we can resize image /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Successfully created port: ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Cannot resize image /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Ensure instance console log exists: /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Successfully updated port: ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:47:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:47:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquired lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:47:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:47:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-ecbde7bf-dd4f-4bf8-bab5-131a94809c7e req-1462686b-494e-4696-81e0-bdd037fb1b26 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Received event network-changed-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:47:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-ecbde7bf-dd4f-4bf8-bab5-131a94809c7e req-1462686b-494e-4696-81e0-bdd037fb1b26 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Refreshing instance network info cache due to event network-changed-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:47:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ecbde7bf-dd4f-4bf8-bab5-131a94809c7e req-1462686b-494e-4696-81e0-bdd037fb1b26 service nova] Acquiring lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:47:35 user nova-compute[75100]: DEBUG nova.network.neutron [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.network.neutron [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Updating instance_info_cache with network_info: [{"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Releasing lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Instance network_info: |[{"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ecbde7bf-dd4f-4bf8-bab5-131a94809c7e req-1462686b-494e-4696-81e0-bdd037fb1b26 service nova] Acquired lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-ecbde7bf-dd4f-4bf8-bab5-131a94809c7e req-1462686b-494e-4696-81e0-bdd037fb1b26 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Refreshing network info cache for port ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Start _get_guest_xml network_info=[{"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:47:36 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:47:36 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1079382605',display_name='tempest-AttachVolumeNegativeTest-server-1079382605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1079382605',id=47,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYlX2xfI+YGnJike6qkbMM8Z45jH2L0DfktnNQMoEp3qC9e2MFJoAVaFyBnKH/Q4oBVIgHI9yGxKxEIluMKKjP5NMmReRHM1etbiOGt8yclaRy4Ikf+kN9Wlx4KnKhK5A==',key_name='tempest-keypair-900436917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6352bffe5fa144f996e2ba07f69f4ee4',ramdisk_id='',reservation_id='r-m17j0rh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2126330685',owner_user_name='tempest-AttachVolumeNegativeTest-2126330685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fde156049464deba4b3a3125712baa9',uuid=165155e1-d159-4320-b12f-51dfb6e3e937,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converting VIF {"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:f7:30,bridge_name='br-int',has_traffic_filtering=True,id=ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2cfcd4-fd') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.objects.instance [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'pci_devices' on Instance uuid 165155e1-d159-4320-b12f-51dfb6e3e937 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:47:36 user nova-compute[75100]:   <uuid>165155e1-d159-4320-b12f-51dfb6e3e937</uuid>
Nov 13 17:47:36 user nova-compute[75100]:   <name>instance-0000002f</name>
Nov 13 17:47:36 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:47:36 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:47:36 user nova-compute[75100]:   <metadata>
Nov 13 17:47:36 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:47:36 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:47:36 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1079382605</nova:name>
Nov 13 17:47:36 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:47:36</nova:creationTime>
Nov 13 17:47:36 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:47:36 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:47:36 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:47:36 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:47:36 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:47:36 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:47:36 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:47:36 user nova-compute[75100]:       <nova:owner>
Nov 13 17:47:36 user nova-compute[75100]:         <nova:user uuid="9fde156049464deba4b3a3125712baa9">tempest-AttachVolumeNegativeTest-2126330685-project-member</nova:user>
Nov 13 17:47:36 user nova-compute[75100]:         <nova:project uuid="6352bffe5fa144f996e2ba07f69f4ee4">tempest-AttachVolumeNegativeTest-2126330685</nova:project>
Nov 13 17:47:36 user nova-compute[75100]:       </nova:owner>
Nov 13 17:47:36 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:47:36 user nova-compute[75100]:       <nova:ports>
Nov 13 17:47:36 user nova-compute[75100]:         <nova:port uuid="ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5">
Nov 13 17:47:36 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 17:47:36 user nova-compute[75100]:         </nova:port>
Nov 13 17:47:36 user nova-compute[75100]:       </nova:ports>
Nov 13 17:47:36 user nova-compute[75100]:     </nova:instance>
Nov 13 17:47:36 user nova-compute[75100]:   </metadata>
Nov 13 17:47:36 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:47:36 user nova-compute[75100]:     <system>
Nov 13 17:47:36 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:47:36 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:47:36 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:47:36 user nova-compute[75100]:       <entry name="serial">165155e1-d159-4320-b12f-51dfb6e3e937</entry>
Nov 13 17:47:36 user nova-compute[75100]:       <entry name="uuid">165155e1-d159-4320-b12f-51dfb6e3e937</entry>
Nov 13 17:47:36 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:47:36 user nova-compute[75100]:     </system>
Nov 13 17:47:36 user nova-compute[75100]:   </sysinfo>
Nov 13 17:47:36 user nova-compute[75100]:   <os>
Nov 13 17:47:36 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:47:36 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:47:36 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:47:36 user nova-compute[75100]:   </os>
Nov 13 17:47:36 user nova-compute[75100]:   <features>
Nov 13 17:47:36 user nova-compute[75100]:     <acpi/>
Nov 13 17:47:36 user nova-compute[75100]:     <apic/>
Nov 13 17:47:36 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:47:36 user nova-compute[75100]:   </features>
Nov 13 17:47:36 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:47:36 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:47:36 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:47:36 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:47:36 user nova-compute[75100]:   </clock>
Nov 13 17:47:36 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:47:36 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:47:36 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:47:36 user nova-compute[75100]:   </cpu>
Nov 13 17:47:36 user nova-compute[75100]:   <devices>
Nov 13 17:47:36 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:47:36 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:47:36 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk"/>
Nov 13 17:47:36 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:47:36 user nova-compute[75100]:     </disk>
Nov 13 17:47:36 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:47:36 user nova-compute[75100]:       <mac address="fa:16:3e:af:f7:30"/>
Nov 13 17:47:36 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:47:36 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:47:36 user nova-compute[75100]:       <target dev="tapce2cfcd4-fd"/>
Nov 13 17:47:36 user nova-compute[75100]:     </interface>
Nov 13 17:47:36 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:47:36 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/console.log" append="off"/>
Nov 13 17:47:36 user nova-compute[75100]:     </serial>
Nov 13 17:47:36 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:47:36 user nova-compute[75100]:     <video>
Nov 13 17:47:36 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:47:36 user nova-compute[75100]:     </video>
Nov 13 17:47:36 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:47:36 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:47:36 user nova-compute[75100]:     </rng>
Nov 13 17:47:36 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:47:36 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:47:36 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:47:36 user nova-compute[75100]:     </memballoon>
Nov 13 17:47:36 user nova-compute[75100]:   </devices>
Nov 13 17:47:36 user nova-compute[75100]: </domain>
Nov 13 17:47:36 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1079382605',display_name='tempest-AttachVolumeNegativeTest-server-1079382605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1079382605',id=47,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYlX2xfI+YGnJike6qkbMM8Z45jH2L0DfktnNQMoEp3qC9e2MFJoAVaFyBnKH/Q4oBVIgHI9yGxKxEIluMKKjP5NMmReRHM1etbiOGt8yclaRy4Ikf+kN9Wlx4KnKhK5A==',key_name='tempest-keypair-900436917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6352bffe5fa144f996e2ba07f69f4ee4',ramdisk_id='',reservation_id='r-m17j0rh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2126330685',owner_user_name='tempest-AttachVolumeNegativeTest-2126330685-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:47:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fde156049464deba4b3a3125712baa9',uuid=165155e1-d159-4320-b12f-51dfb6e3e937,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converting VIF {"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:f7:30,bridge_name='br-int',has_traffic_filtering=True,id=ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2cfcd4-fd') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG os_vif [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:f7:30,bridge_name='br-int',has_traffic_filtering=True,id=ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2cfcd4-fd') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94d4bcc6-e3fd-562c-aede-f4b588d8849c', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce2cfcd4-fd, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce2cfcd4-fd, col_values=(('qos', UUID('b39b4ce7-f719-4682-8937-f7fa3734b2ab')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce2cfcd4-fd, col_values=(('external_ids', {'iface-id': 'ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:f7:30', 'vm-uuid': '165155e1-d159-4320-b12f-51dfb6e3e937'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:36 user nova-compute[75100]: INFO os_vif [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:f7:30,bridge_name='br-int',has_traffic_filtering=True,id=ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2cfcd4-fd')
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No VIF found with MAC fa:16:3e:af:f7:30, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-ecbde7bf-dd4f-4bf8-bab5-131a94809c7e req-1462686b-494e-4696-81e0-bdd037fb1b26 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Updated VIF entry in instance network info cache for port ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-ecbde7bf-dd4f-4bf8-bab5-131a94809c7e req-1462686b-494e-4696-81e0-bdd037fb1b26 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Updating instance_info_cache with network_info: [{"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:47:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ecbde7bf-dd4f-4bf8-bab5-131a94809c7e req-1462686b-494e-4696-81e0-bdd037fb1b26 service nova] Releasing lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:47:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-5d32b183-dc17-4989-b06b-fc03df3e0f48 req-191f047a-11d3-4b44-abee-fdee5433b64e service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Received event network-vif-plugged-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:47:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5d32b183-dc17-4989-b06b-fc03df3e0f48 req-191f047a-11d3-4b44-abee-fdee5433b64e service nova] Acquiring lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5d32b183-dc17-4989-b06b-fc03df3e0f48 req-191f047a-11d3-4b44-abee-fdee5433b64e service nova] Lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5d32b183-dc17-4989-b06b-fc03df3e0f48 req-191f047a-11d3-4b44-abee-fdee5433b64e service nova] Lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-5d32b183-dc17-4989-b06b-fc03df3e0f48 req-191f047a-11d3-4b44-abee-fdee5433b64e service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] No waiting events found dispatching network-vif-plugged-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:47:37 user nova-compute[75100]: WARNING nova.compute.manager [req-5d32b183-dc17-4989-b06b-fc03df3e0f48 req-191f047a-11d3-4b44-abee-fdee5433b64e service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Received unexpected event network-vif-plugged-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 for instance with vm_state building and task_state spawning.
Nov 13 17:47:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:47:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Instance spawned successfully.
Nov 13 17:47:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-ca514574-07b8-48de-a91c-e42975134ea1 req-e80ce185-4a2c-4e44-9c40-3a83478f0b03 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Received event network-vif-plugged-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ca514574-07b8-48de-a91c-e42975134ea1 req-e80ce185-4a2c-4e44-9c40-3a83478f0b03 service nova] Acquiring lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ca514574-07b8-48de-a91c-e42975134ea1 req-e80ce185-4a2c-4e44-9c40-3a83478f0b03 service nova] Lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ca514574-07b8-48de-a91c-e42975134ea1 req-e80ce185-4a2c-4e44-9c40-3a83478f0b03 service nova] Lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-ca514574-07b8-48de-a91c-e42975134ea1 req-e80ce185-4a2c-4e44-9c40-3a83478f0b03 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] No waiting events found dispatching network-vif-plugged-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:47:39 user nova-compute[75100]: WARNING nova.compute.manager [req-ca514574-07b8-48de-a91c-e42975134ea1 req-e80ce185-4a2c-4e44-9c40-3a83478f0b03 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Received unexpected event network-vif-plugged-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 for instance with vm_state building and task_state spawning.
Nov 13 17:47:39 user nova-compute[75100]: INFO nova.compute.manager [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 13 17:47:39 user nova-compute[75100]: DEBUG nova.compute.manager [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:47:40 user nova-compute[75100]: INFO nova.compute.manager [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Took 6.32 seconds to build instance.
Nov 13 17:47:40 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-90abe581-c587-4bb3-a328-3be260719629 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "165155e1-d159-4320-b12f-51dfb6e3e937" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.420s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:47:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:47:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:47:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:47:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:47:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:47:41 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 88ac770d-eefa-4c0c-86e7-2d50fd322d28 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:47:41 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updating instance_info_cache with network_info: [{"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:47:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:47:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:47:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:47:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:47:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:47:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:47:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:47:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json" returned: 0 in 0.367s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:44 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:47:44 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:47:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=25.141033172607422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 88ac770d-eefa-4c0c-86e7-2d50fd322d28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:47:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 165155e1-d159-4320-b12f-51dfb6e3e937 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:47:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:47:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:47:45 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:47:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:47:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:47:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:47:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:47:46 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:47:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:47:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:47:57 user nova-compute[75100]: INFO nova.compute.claims [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Claim successful on node user
Nov 13 17:47:57 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG nova.network.neutron [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:47:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:47:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG nova.policy [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059e22ba39774ecc93789262a27570a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d095299b54496bae4390b9b462a8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:47:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Creating image(s)
Nov 13 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "/opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "/opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk 1073741824" returned: 0 in 0.051s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Successfully created port: b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Cannot resize image /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Ensure instance console log exists: /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Successfully updated port: b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "refresh_cache-e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquired lock "refresh_cache-e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG nova.network.neutron [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-e925d0ae-7afa-495c-9581-ca78ac597e7f req-780e43e9-ba22-4c5d-b5f1-df35d8d65f57 service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Received event network-changed-b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG nova.compute.manager [req-e925d0ae-7afa-495c-9581-ca78ac597e7f req-780e43e9-ba22-4c5d-b5f1-df35d8d65f57 service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Refreshing instance network info cache due to event network-changed-b73a3e43-d8de-4dbc-be57-609f5f5704fd. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:47:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e925d0ae-7afa-495c-9581-ca78ac597e7f req-780e43e9-ba22-4c5d-b5f1-df35d8d65f57 service nova] Acquiring lock "refresh_cache-e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.network.neutron [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Updating instance_info_cache with network_info: [{"id": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "address": "fa:16:3e:58:b9:4b", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73a3e43-d8", "ovs_interfaceid": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Releasing lock "refresh_cache-e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Instance network_info: |[{"id": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "address": "fa:16:3e:58:b9:4b", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73a3e43-d8", "ovs_interfaceid": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e925d0ae-7afa-495c-9581-ca78ac597e7f req-780e43e9-ba22-4c5d-b5f1-df35d8d65f57 service nova] Acquired lock "refresh_cache-e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-e925d0ae-7afa-495c-9581-ca78ac597e7f req-780e43e9-ba22-4c5d-b5f1-df35d8d65f57 service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Refreshing network info cache for port b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Start _get_guest_xml network_info=[{"id": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "address": "fa:16:3e:58:b9:4b", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73a3e43-d8", "ovs_interfaceid": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:47:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:47:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:47:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1864914274',display_name='tempest-VolumesSnapshotTestJSON-instance-1864914274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1864914274',id=48,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwD01Y6oPqUq36R5dSj1eg1uxaE/mtBEf65yqmblXNfw7nZ3RMI6qlGFhZXr+N6KGT9Lnze4hm/CinyGUIZ9E6JeJWwZgjO6yC4/rxNAVXTzHsMJmjztlOHKR8z9bM5Bw==',key_name='tempest-keypair-1580968712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17d095299b54496bae4390b9b462a8d9',ramdisk_id='',reservation_id='r-zosbm6v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1809692111',owner_user_name='tempest-VolumesSnapshotTestJSON-1809692111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059e22ba39774ecc93789262a27570a4',uuid=e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "address": "fa:16:3e:58:b9:4b", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73a3e43-d8", "ovs_interfaceid": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Converting VIF {"id": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "address": "fa:16:3e:58:b9:4b", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73a3e43-d8", "ovs_interfaceid": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:b9:4b,bridge_name='br-int',has_traffic_filtering=True,id=b73a3e43-d8de-4dbc-be57-609f5f5704fd,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73a3e43-d8') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lazy-loading 'pci_devices' on Instance uuid e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:47:59 user nova-compute[75100]:   <uuid>e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a</uuid>
Nov 13 17:47:59 user nova-compute[75100]:   <name>instance-00000030</name>
Nov 13 17:47:59 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:47:59 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:47:59 user nova-compute[75100]:   <metadata>
Nov 13 17:47:59 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:47:59 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:47:59 user nova-compute[75100]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1864914274</nova:name>
Nov 13 17:47:59 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:47:59</nova:creationTime>
Nov 13 17:47:59 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:47:59 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:47:59 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:47:59 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:47:59 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:47:59 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:47:59 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:47:59 user nova-compute[75100]:       <nova:owner>
Nov 13 17:47:59 user nova-compute[75100]:         <nova:user uuid="059e22ba39774ecc93789262a27570a4">tempest-VolumesSnapshotTestJSON-1809692111-project-member</nova:user>
Nov 13 17:47:59 user nova-compute[75100]:         <nova:project uuid="17d095299b54496bae4390b9b462a8d9">tempest-VolumesSnapshotTestJSON-1809692111</nova:project>
Nov 13 17:47:59 user nova-compute[75100]:       </nova:owner>
Nov 13 17:47:59 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:47:59 user nova-compute[75100]:       <nova:ports>
Nov 13 17:47:59 user nova-compute[75100]:         <nova:port uuid="b73a3e43-d8de-4dbc-be57-609f5f5704fd">
Nov 13 17:47:59 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 17:47:59 user nova-compute[75100]:         </nova:port>
Nov 13 17:47:59 user nova-compute[75100]:       </nova:ports>
Nov 13 17:47:59 user nova-compute[75100]:     </nova:instance>
Nov 13 17:47:59 user nova-compute[75100]:   </metadata>
Nov 13 17:47:59 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:47:59 user nova-compute[75100]:     <system>
Nov 13 17:47:59 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:47:59 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:47:59 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:47:59 user nova-compute[75100]:       <entry name="serial">e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a</entry>
Nov 13 17:47:59 user nova-compute[75100]:       <entry name="uuid">e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a</entry>
Nov 13 17:47:59 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:47:59 user nova-compute[75100]:     </system>
Nov 13 17:47:59 user nova-compute[75100]:   </sysinfo>
Nov 13 17:47:59 user nova-compute[75100]:   <os>
Nov 13 17:47:59 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:47:59 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:47:59 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:47:59 user nova-compute[75100]:   </os>
Nov 13 17:47:59 user nova-compute[75100]:   <features>
Nov 13 17:47:59 user nova-compute[75100]:     <acpi/>
Nov 13 17:47:59 user nova-compute[75100]:     <apic/>
Nov 13 17:47:59 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:47:59 user nova-compute[75100]:   </features>
Nov 13 17:47:59 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:47:59 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:47:59 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:47:59 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:47:59 user nova-compute[75100]:   </clock>
Nov 13 17:47:59 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:47:59 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:47:59 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:47:59 user nova-compute[75100]:   </cpu>
Nov 13 17:47:59 user nova-compute[75100]:   <devices>
Nov 13 17:47:59 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:47:59 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:47:59 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk"/>
Nov 13 17:47:59 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:47:59 user nova-compute[75100]:     </disk>
Nov 13 17:47:59 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:47:59 user nova-compute[75100]:       <mac address="fa:16:3e:58:b9:4b"/>
Nov 13 17:47:59 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:47:59 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:47:59 user nova-compute[75100]:       <target dev="tapb73a3e43-d8"/>
Nov 13 17:47:59 user nova-compute[75100]:     </interface>
Nov 13 17:47:59 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:47:59 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/console.log" append="off"/>
Nov 13 17:47:59 user nova-compute[75100]:     </serial>
Nov 13 17:47:59 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:47:59 user nova-compute[75100]:     <video>
Nov 13 17:47:59 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:47:59 user nova-compute[75100]:     </video>
Nov 13 17:47:59 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:47:59 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:47:59 user nova-compute[75100]:     </rng>
Nov 13 17:47:59 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:47:59 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:47:59 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:47:59 user nova-compute[75100]:     </memballoon>
Nov 13 17:47:59 user nova-compute[75100]:   </devices>
Nov 13 17:47:59 user nova-compute[75100]: </domain>
Nov 13 17:47:59 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:47:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1864914274',display_name='tempest-VolumesSnapshotTestJSON-instance-1864914274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1864914274',id=48,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwD01Y6oPqUq36R5dSj1eg1uxaE/mtBEf65yqmblXNfw7nZ3RMI6qlGFhZXr+N6KGT9Lnze4hm/CinyGUIZ9E6JeJWwZgjO6yC4/rxNAVXTzHsMJmjztlOHKR8z9bM5Bw==',key_name='tempest-keypair-1580968712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17d095299b54496bae4390b9b462a8d9',ramdisk_id='',reservation_id='r-zosbm6v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1809692111',owner_user_name='tempest-VolumesSnapshotTestJSON-1809692111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059e22ba39774ecc93789262a27570a4',uuid=e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "address": "fa:16:3e:58:b9:4b", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73a3e43-d8", "ovs_interfaceid": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Converting VIF {"id": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "address": "fa:16:3e:58:b9:4b", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73a3e43-d8", "ovs_interfaceid": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:b9:4b,bridge_name='br-int',has_traffic_filtering=True,id=b73a3e43-d8de-4dbc-be57-609f5f5704fd,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73a3e43-d8') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG os_vif [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:b9:4b,bridge_name='br-int',has_traffic_filtering=True,id=b73a3e43-d8de-4dbc-be57-609f5f5704fd,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73a3e43-d8') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19899ccd-93c1-52dd-a662-d16a2ccfe214', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb73a3e43-d8, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb73a3e43-d8, col_values=(('qos', UUID('5d4ab567-e945-4f8a-b76d-8c6dbc0a452f')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb73a3e43-d8, col_values=(('external_ids', {'iface-id': 'b73a3e43-d8de-4dbc-be57-609f5f5704fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:b9:4b', 'vm-uuid': 'e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:47:59 user nova-compute[75100]: INFO os_vif [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:b9:4b,bridge_name='br-int',has_traffic_filtering=True,id=b73a3e43-d8de-4dbc-be57-609f5f5704fd,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73a3e43-d8')
Nov 13 17:47:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] No VIF found with MAC fa:16:3e:58:b9:4b, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-e925d0ae-7afa-495c-9581-ca78ac597e7f req-780e43e9-ba22-4c5d-b5f1-df35d8d65f57 service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Updated VIF entry in instance network info cache for port b73a3e43-d8de-4dbc-be57-609f5f5704fd. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG nova.network.neutron [req-e925d0ae-7afa-495c-9581-ca78ac597e7f req-780e43e9-ba22-4c5d-b5f1-df35d8d65f57 service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Updating instance_info_cache with network_info: [{"id": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "address": "fa:16:3e:58:b9:4b", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73a3e43-d8", "ovs_interfaceid": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:47:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e925d0ae-7afa-495c-9581-ca78ac597e7f req-780e43e9-ba22-4c5d-b5f1-df35d8d65f57 service nova] Releasing lock "refresh_cache-e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:48:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-2482fdbb-4890-44ae-9e46-aa56eb16cc86 req-69fa16d4-9641-4dfc-9b6f-4243360b2c3f service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Received event network-vif-plugged-b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:48:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2482fdbb-4890-44ae-9e46-aa56eb16cc86 req-69fa16d4-9641-4dfc-9b6f-4243360b2c3f service nova] Acquiring lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:48:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2482fdbb-4890-44ae-9e46-aa56eb16cc86 req-69fa16d4-9641-4dfc-9b6f-4243360b2c3f service nova] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:48:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2482fdbb-4890-44ae-9e46-aa56eb16cc86 req-69fa16d4-9641-4dfc-9b6f-4243360b2c3f service nova] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:48:01 user nova-compute[75100]: DEBUG nova.compute.manager [req-2482fdbb-4890-44ae-9e46-aa56eb16cc86 req-69fa16d4-9641-4dfc-9b6f-4243360b2c3f service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] No waiting events found dispatching network-vif-plugged-b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:48:01 user nova-compute[75100]: WARNING nova.compute.manager [req-2482fdbb-4890-44ae-9e46-aa56eb16cc86 req-69fa16d4-9641-4dfc-9b6f-4243360b2c3f service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Received unexpected event network-vif-plugged-b73a3e43-d8de-4dbc-be57-609f5f5704fd for instance with vm_state building and task_state spawning.
Nov 13 17:48:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:48:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:48:02 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Instance spawned successfully.
Nov 13 17:48:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:48:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:48:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:48:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:48:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:48:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:48:02 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:48:02 user nova-compute[75100]: INFO nova.compute.manager [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 13 17:48:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:48:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:02 user nova-compute[75100]: INFO nova.compute.manager [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Took 5.58 seconds to build instance.
Nov 13 17:48:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-332d3df1-16b0-48e5-bffb-464df9134864 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.686s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:48:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-7c957788-5914-403b-84c1-7dcd0a6c9e01 req-80e5f078-6bcf-4be6-8d9b-4df94aa552c1 service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Received event network-vif-plugged-b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:48:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7c957788-5914-403b-84c1-7dcd0a6c9e01 req-80e5f078-6bcf-4be6-8d9b-4df94aa552c1 service nova] Acquiring lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:48:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7c957788-5914-403b-84c1-7dcd0a6c9e01 req-80e5f078-6bcf-4be6-8d9b-4df94aa552c1 service nova] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:48:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7c957788-5914-403b-84c1-7dcd0a6c9e01 req-80e5f078-6bcf-4be6-8d9b-4df94aa552c1 service nova] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:48:03 user nova-compute[75100]: DEBUG nova.compute.manager [req-7c957788-5914-403b-84c1-7dcd0a6c9e01 req-80e5f078-6bcf-4be6-8d9b-4df94aa552c1 service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] No waiting events found dispatching network-vif-plugged-b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:48:03 user nova-compute[75100]: WARNING nova.compute.manager [req-7c957788-5914-403b-84c1-7dcd0a6c9e01 req-80e5f078-6bcf-4be6-8d9b-4df94aa552c1 service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Received unexpected event network-vif-plugged-b73a3e43-d8de-4dbc-be57-609f5f5704fd for instance with vm_state active and task_state None.
Nov 13 17:48:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-ab7ba92b-beb1-4c6f-b2ed-2330944b9748 req-7398a486-9a64-4c1a-9e44-88b385287f6d service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-changed-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:48:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-ab7ba92b-beb1-4c6f-b2ed-2330944b9748 req-7398a486-9a64-4c1a-9e44-88b385287f6d service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Refreshing instance network info cache due to event network-changed-d535aaf8-4bce-4fdb-924b-a4fbb91d204b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:48:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ab7ba92b-beb1-4c6f-b2ed-2330944b9748 req-7398a486-9a64-4c1a-9e44-88b385287f6d service nova] Acquiring lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:48:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ab7ba92b-beb1-4c6f-b2ed-2330944b9748 req-7398a486-9a64-4c1a-9e44-88b385287f6d service nova] Acquired lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:48:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-ab7ba92b-beb1-4c6f-b2ed-2330944b9748 req-7398a486-9a64-4c1a-9e44-88b385287f6d service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Refreshing network info cache for port d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:48:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-ab7ba92b-beb1-4c6f-b2ed-2330944b9748 req-7398a486-9a64-4c1a-9e44-88b385287f6d service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updated VIF entry in instance network info cache for port d535aaf8-4bce-4fdb-924b-a4fbb91d204b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:48:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-ab7ba92b-beb1-4c6f-b2ed-2330944b9748 req-7398a486-9a64-4c1a-9e44-88b385287f6d service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updating instance_info_cache with network_info: [{"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:48:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ab7ba92b-beb1-4c6f-b2ed-2330944b9748 req-7398a486-9a64-4c1a-9e44-88b385287f6d service nova] Releasing lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:48:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:48:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:48:39 user nova-compute[75100]: INFO nova.compute.manager [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Shelving
Nov 13 17:48:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:39 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:48:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-4817deac-4090-47c2-884c-84dc020a063b req-bf00be44-b738-4727-b3c8-4426e3663174 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-vif-unplugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:48:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4817deac-4090-47c2-884c-84dc020a063b req-bf00be44-b738-4727-b3c8-4426e3663174 service nova] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:48:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4817deac-4090-47c2-884c-84dc020a063b req-bf00be44-b738-4727-b3c8-4426e3663174 service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:48:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4817deac-4090-47c2-884c-84dc020a063b req-bf00be44-b738-4727-b3c8-4426e3663174 service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:48:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-4817deac-4090-47c2-884c-84dc020a063b req-bf00be44-b738-4727-b3c8-4426e3663174 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] No waiting events found dispatching network-vif-unplugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:48:39 user nova-compute[75100]: WARNING nova.compute.manager [req-4817deac-4090-47c2-884c-84dc020a063b req-bf00be44-b738-4727-b3c8-4426e3663174 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received unexpected event network-vif-unplugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b for instance with vm_state active and task_state shelving.
Nov 13 17:48:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Instance destroyed successfully.
Nov 13 17:48:39 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Beginning cold snapshot process
Nov 13 17:48:40 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:48:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk /opt/stack/data/nova/instances/snapshots/tmpvotf_7bv/ed4efd88e1c14edbb858e20fe6a74421 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:48:40 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk /opt/stack/data/nova/instances/snapshots/tmpvotf_7bv/ed4efd88e1c14edbb858e20fe6a74421" returned: 0 in 0.595s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:48:40 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Snapshot extracted, beginning image upload
Nov 13 17:48:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:48:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-bbc5df15-2f56-4d5f-b02f-3463d4bf7435 req-f0c67e27-0c5e-46f0-ad57-dbd5b092e2e5 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:48:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bbc5df15-2f56-4d5f-b02f-3463d4bf7435 req-f0c67e27-0c5e-46f0-ad57-dbd5b092e2e5 service nova] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:48:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bbc5df15-2f56-4d5f-b02f-3463d4bf7435 req-f0c67e27-0c5e-46f0-ad57-dbd5b092e2e5 service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:48:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bbc5df15-2f56-4d5f-b02f-3463d4bf7435 req-f0c67e27-0c5e-46f0-ad57-dbd5b092e2e5 service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:48:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-bbc5df15-2f56-4d5f-b02f-3463d4bf7435 req-f0c67e27-0c5e-46f0-ad57-dbd5b092e2e5 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] No waiting events found dispatching network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:48:41 user nova-compute[75100]: WARNING nova.compute.manager [req-bbc5df15-2f56-4d5f-b02f-3463d4bf7435 req-f0c67e27-0c5e-46f0-ad57-dbd5b092e2e5 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received unexpected event network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b for instance with vm_state active and task_state shelving_image_uploading.
Nov 13 17:48:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:48:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:48:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:48:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:48:42 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:48:42 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Updating instance_info_cache with network_info: [{"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:48:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:48:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:48:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:43 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Snapshot image upload complete
Nov 13 17:48:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:48:43 user nova-compute[75100]: INFO nova.compute.manager [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Shelve offloading
Nov 13 17:48:43 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Instance destroyed successfully.
Nov 13 17:48:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquired lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG nova.network.neutron [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updating instance_info_cache with network_info: [{"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Releasing lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:48:43 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:48:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Instance destroyed successfully.
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'resources' on Instance uuid 88ac770d-eefa-4c0c-86e7-2d50fd322d28 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2137819338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2137819338',id=46,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvKi8s04o0q2ooK0TBJF2ZO2Wdyk2/m96B9PWdof7c/QR3DTCOboEB2/R6UqnM9GkXYVSP1gUco+D6Np22hZLqeqchxniMB8AiYZoKAUvW73f6HYLMUUI3puDPFNU1uOw==',key_name='tempest-keypair-143936512',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:46:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='db67a12bfc7f48b380175a6871012f25',ramdisk_id='',reservation_id='r-n3ft0jyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1414200693',owner_user_name='tempest-AttachVolumeShelveTestJSON-1414200693-project-member',shelved_at='2023-11-13T17:48:43.017450',shelved_host='user',shelved_image_id='313c5107-2587-40d0-a32b-6653ecb2bf58'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54440f660c64141ad91285ddef65ca9',uuid=88ac770d-eefa-4c0c-86e7-2d50fd322d28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converting VIF {"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG os_vif [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-25e5560a-53d8-4622-bf09-40dd29c3a3f0 req-667d3a9f-240d-4250-b097-e2afdbddd2a6 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-changed-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.compute.manager [req-25e5560a-53d8-4622-bf09-40dd29c3a3f0 req-667d3a9f-240d-4250-b097-e2afdbddd2a6 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Refreshing instance network info cache due to event network-changed-d535aaf8-4bce-4fdb-924b-a4fbb91d204b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-25e5560a-53d8-4622-bf09-40dd29c3a3f0 req-667d3a9f-240d-4250-b097-e2afdbddd2a6 service nova] Acquiring lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-25e5560a-53d8-4622-bf09-40dd29c3a3f0 req-667d3a9f-240d-4250-b097-e2afdbddd2a6 service nova] Acquired lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.network.neutron [req-25e5560a-53d8-4622-bf09-40dd29c3a3f0 req-667d3a9f-240d-4250-b097-e2afdbddd2a6 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Refreshing network info cache for port d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd535aaf8-4b, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9f944bd-1292-4665-9841-f7c3b5739220) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:48:44 user nova-compute[75100]: INFO os_vif [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b')
Nov 13 17:48:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Deleting instance files /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28_del
Nov 13 17:48:44 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Deletion of /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28_del complete
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json" returned: 1 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:48:44 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000002e, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:48:44 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Deleted allocations for instance 88ac770d-eefa-4c0c-86e7-2d50fd322d28
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'numa_topology' on Instance uuid 88ac770d-eefa-4c0c-86e7-2d50fd322d28 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.objects.base [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Object Instance<88ac770d-eefa-4c0c-86e7-2d50fd322d28> lazy-loaded attributes: resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-9fb5fe46-8923-4348-9475-fbe1c00e63a9 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.711s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:48:44 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:48:44 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=25.01811981201172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 165155e1-d159-4320-b12f-51dfb6e3e937 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:48:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:48:45 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:48:45 user nova-compute[75100]: DEBUG nova.network.neutron [req-25e5560a-53d8-4622-bf09-40dd29c3a3f0 req-667d3a9f-240d-4250-b097-e2afdbddd2a6 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updated VIF entry in instance network info cache for port d535aaf8-4bce-4fdb-924b-a4fbb91d204b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:48:45 user nova-compute[75100]: DEBUG nova.network.neutron [req-25e5560a-53d8-4622-bf09-40dd29c3a3f0 req-667d3a9f-240d-4250-b097-e2afdbddd2a6 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updating instance_info_cache with network_info: [{"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:48:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:48:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-25e5560a-53d8-4622-bf09-40dd29c3a3f0 req-667d3a9f-240d-4250-b097-e2afdbddd2a6 service nova] Releasing lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:48:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:48:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:48:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:48:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:48:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:48:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:48:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:48:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:48:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:48:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:48:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:48:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:48:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:49:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:49:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:49:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:49:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:49:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:49:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:49:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:49:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:49:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:49:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:49:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:49:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:49:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:49:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:49:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:49:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:49:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-88789e9c-4ee5-491c-863e-e44e61a173b9 req-c38c62ca-80ff-40e2-a6ba-5d2de79fdb77 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Received event network-changed-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:49:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-88789e9c-4ee5-491c-863e-e44e61a173b9 req-c38c62ca-80ff-40e2-a6ba-5d2de79fdb77 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Refreshing instance network info cache due to event network-changed-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:49:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-88789e9c-4ee5-491c-863e-e44e61a173b9 req-c38c62ca-80ff-40e2-a6ba-5d2de79fdb77 service nova] Acquiring lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:49:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-88789e9c-4ee5-491c-863e-e44e61a173b9 req-c38c62ca-80ff-40e2-a6ba-5d2de79fdb77 service nova] Acquired lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:49:24 user nova-compute[75100]: DEBUG nova.network.neutron [req-88789e9c-4ee5-491c-863e-e44e61a173b9 req-c38c62ca-80ff-40e2-a6ba-5d2de79fdb77 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Refreshing network info cache for port ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:49:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-88789e9c-4ee5-491c-863e-e44e61a173b9 req-c38c62ca-80ff-40e2-a6ba-5d2de79fdb77 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Updated VIF entry in instance network info cache for port ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:49:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-88789e9c-4ee5-491c-863e-e44e61a173b9 req-c38c62ca-80ff-40e2-a6ba-5d2de79fdb77 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Updating instance_info_cache with network_info: [{"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:49:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-88789e9c-4ee5-491c-863e-e44e61a173b9 req-c38c62ca-80ff-40e2-a6ba-5d2de79fdb77 service nova] Releasing lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "165155e1-d159-4320-b12f-51dfb6e3e937" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "165155e1-d159-4320-b12f-51dfb6e3e937" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG nova.objects.instance [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'flavor' on Instance uuid 165155e1-d159-4320-b12f-51dfb6e3e937 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "165155e1-d159-4320-b12f-51dfb6e3e937" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "165155e1-d159-4320-b12f-51dfb6e3e937" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "165155e1-d159-4320-b12f-51dfb6e3e937" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:49:26 user nova-compute[75100]: INFO nova.compute.manager [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Attaching volume c8f3a266-d362-434e-af0a-969966521176 to /dev/vdb
Nov 13 17:49:26 user nova-compute[75100]: DEBUG os_brick.utils [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eca3f0-838f-41ad-ba62-8ae215377d93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[174a83a1-1f37-438b-a18a-34308e610970]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ab77a-9d8f-41c0-b83d-602b60b82e96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe87fb7e-238e-4ee9-b829-ed26b0b9c636]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:49:26 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:49:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c5c812-23fd-44d2-a6b8-07c03b94f58e]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG os_brick.utils [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:49:26 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Updating existing volume attachment record: 94169d5c-88a4-46e5-ac1a-de1ab43ae844 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:49:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBaDeARX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:49:30 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:49:30 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:49:30 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbf9631-9f1b-4d16-8dfe-e337ec8b4102]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:49:30 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1342f3-e907-45a7-b7c4-d3d9c5fa9508]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176] added
Nov 13 17:49:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef5bd1e-ec3c-406b-9478-aeadc70b7346]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb427795-6efa-4dd6-8dfa-285093a2a2c4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBaDeARX {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBaDeARX" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a30cf5-d084-4423-b634-486e90e37cf0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WBaDeARX'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce15f9a9-73fd-4a88-99b2-9fdb262166af]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b41ed8-4248-4d7d-b5cb-c3deacee09f8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:49:30 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:49:30 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:49:30 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 17:49:30 user nova-compute[75100]: 
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cab2c53-01cd-41f4-867b-ce1f82ba7e62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176, portal: 172.16.0.220,3260]
Nov 13 17:49:30 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176, portal: 172.16.0.220,3260] successful.
Nov 13 17:49:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af862551-25d5-4eaf-9384-09ceb1c961b0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b24c0c1-457c-4c8d-a9b2-072fdbddaed2]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 (non-flash)
Nov 13 17:49:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 (non-flash)
Nov 13 17:49:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[be374ad2-3a89-4fad-9352-06c46d552d22]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:49:31 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:49:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBaDeARX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:49:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:49:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26634663737346431', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:49:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634663737346431', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:49:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'flavor' on Instance uuid 165155e1-d159-4320-b12f-51dfb6e3e937 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:49:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:49:31 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:49:31 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:49:31 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:49:31 user nova-compute[75100]:   <serial>c8f3a266-d362-434e-af0a-969966521176</serial>
Nov 13 17:49:31 user nova-compute[75100]: </disk>
Nov 13 17:49:31 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:49:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:49:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:49:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] No VIF found with MAC fa:16:3e:af:f7:30, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:49:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-25676e6d-0da0-4be7-a7ed-5aa3a0e3abd8 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "165155e1-d159-4320-b12f-51dfb6e3e937" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.005s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:49:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "165155e1-d159-4320-b12f-51dfb6e3e937" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:49:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "165155e1-d159-4320-b12f-51dfb6e3e937" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:49:33 user nova-compute[75100]: INFO nova.compute.manager [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Detaching volume c8f3a266-d362-434e-af0a-969966521176
Nov 13 17:49:33 user nova-compute[75100]: INFO nova.virt.block_device [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Attempting to driver detach volume c8f3a266-d362-434e-af0a-969966521176 from mountpoint /dev/vdb
Nov 13 17:49:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Attempting to detach device vdb from instance 165155e1-d159-4320-b12f-51dfb6e3e937 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:49:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:49:33 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:49:33 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:49:33 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:49:33 user nova-compute[75100]:   <serial>c8f3a266-d362-434e-af0a-969966521176</serial>
Nov 13 17:49:33 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:49:33 user nova-compute[75100]: </disk>
Nov 13 17:49:33 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:49:33 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully detached device vdb from instance 165155e1-d159-4320-b12f-51dfb6e3e937 from the persistent domain config.
Nov 13 17:49:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 165155e1-d159-4320-b12f-51dfb6e3e937 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:49:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:49:33 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:49:33 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:49:33 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:49:33 user nova-compute[75100]:   <serial>c8f3a266-d362-434e-af0a-969966521176</serial>
Nov 13 17:49:33 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:49:33 user nova-compute[75100]: </disk>
Nov 13 17:49:33 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:49:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 165155e1-d159-4320-b12f-51dfb6e3e937 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:49:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:49:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:49:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:49:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:49:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:49:42 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:49:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:49:42 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:49:42 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:49:42 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 165155e1-d159-4320-b12f-51dfb6e3e937 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:49:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:43 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Updating instance_info_cache with network_info: [{"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:49:43 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-165155e1-d159-4320-b12f-51dfb6e3e937" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:49:43 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:49:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:49:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:49:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:49:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:49:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:49:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.044841766357422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 165155e1-d159-4320-b12f-51dfb6e3e937 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:49:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:49:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:49:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-c4be5f34-a3ba-4d60-9ea2-b32e8e635adb req-ae9411e2-c3c9-476c-a338-2f20a651ea7f service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Received event network-changed-b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:49:48 user nova-compute[75100]: DEBUG nova.compute.manager [req-c4be5f34-a3ba-4d60-9ea2-b32e8e635adb req-ae9411e2-c3c9-476c-a338-2f20a651ea7f service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Refreshing instance network info cache due to event network-changed-b73a3e43-d8de-4dbc-be57-609f5f5704fd. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:49:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c4be5f34-a3ba-4d60-9ea2-b32e8e635adb req-ae9411e2-c3c9-476c-a338-2f20a651ea7f service nova] Acquiring lock "refresh_cache-e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:49:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c4be5f34-a3ba-4d60-9ea2-b32e8e635adb req-ae9411e2-c3c9-476c-a338-2f20a651ea7f service nova] Acquired lock "refresh_cache-e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:49:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-c4be5f34-a3ba-4d60-9ea2-b32e8e635adb req-ae9411e2-c3c9-476c-a338-2f20a651ea7f service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Refreshing network info cache for port b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:49:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:49:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:49:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-c4be5f34-a3ba-4d60-9ea2-b32e8e635adb req-ae9411e2-c3c9-476c-a338-2f20a651ea7f service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Updated VIF entry in instance network info cache for port b73a3e43-d8de-4dbc-be57-609f5f5704fd. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:49:48 user nova-compute[75100]: DEBUG nova.network.neutron [req-c4be5f34-a3ba-4d60-9ea2-b32e8e635adb req-ae9411e2-c3c9-476c-a338-2f20a651ea7f service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Updating instance_info_cache with network_info: [{"id": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "address": "fa:16:3e:58:b9:4b", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73a3e43-d8", "ovs_interfaceid": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:49:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c4be5f34-a3ba-4d60-9ea2-b32e8e635adb req-ae9411e2-c3c9-476c-a338-2f20a651ea7f service nova] Releasing lock "refresh_cache-e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG nova.objects.instance [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lazy-loading 'flavor' on Instance uuid e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:49:49 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Ignoring supplied device name: /dev/vdb
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:49:49 user nova-compute[75100]: INFO nova.compute.manager [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Attaching volume f073c85e-df54-468b-8273-73c0977f81ba to /dev/vdb
Nov 13 17:49:49 user nova-compute[75100]: DEBUG os_brick.utils [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9671d3a2-fbcf-49a4-a669-409da448e746]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c386ae-63ad-4cda-a7ba-225eadd99da8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[185daa0b-545b-40ee-9664-e490718ce39a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5f015f-3d72-406e-82ca-db49acafa33c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:49:49 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:49:49 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f85a280-45c2-4156-aedc-51ee8bdad031]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG os_brick.utils [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:49:49 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Updating existing volume attachment record: 3dfd17eb-4c86-4a27-8dd8-43069ff51415 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:49:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:49:53 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 165155e1-d159-4320-b12f-51dfb6e3e937 is timed out.
Nov 13 17:49:53 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully detached device vdb from instance 165155e1-d159-4320-b12f-51dfb6e3e937 from the live domain config.
Nov 13 17:49:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBaDeARX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:49:53 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e48506-ae62-4e37-8426-eb6a82d3670b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:49:53 user nova-compute[75100]: No targets found.
Nov 13 17:49:53 user nova-compute[75100]: iSNS:
Nov 13 17:49:53 user nova-compute[75100]: No targets found.
Nov 13 17:49:53 user nova-compute[75100]: STATIC:
Nov 13 17:49:53 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176
Nov 13 17:49:53 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:49:53 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:49:53 user nova-compute[75100]: FIRMWARE:
Nov 13 17:49:53 user nova-compute[75100]: No targets found.
Nov 13 17:49:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:49:53 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:49:53 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[335b5b0a-8ad4-4c8c-9cb4-f60aee4eba6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f200d2f-47b7-48e8-9c4c-d3b1759a06ab]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 (non-flash)
Nov 13 17:49:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 (non-flash)
Nov 13 17:49:53 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c506320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9917e57-40e2-4d5c-b27b-bfd0d8e80931]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqSLulMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:49:53 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fe683f-2ba1-4c0e-8fba-93d7816f7898]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01df554-64c1-4774-a487-0128d1d09825]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea647b76-a668-46c5-8b4d-2e6674b9a9ed]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75f5e76-abc8-4641-bc6b-b39ffb0e59da]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c278ac1-e5d3-464f-95d9-12520d04bed1]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176, portal: 172.16.0.220,3260]
Nov 13 17:49:54 user nova-compute[75100]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176, portal: 172.16.0.220,3260] successful.
Nov 13 17:49:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f3a266-d362-434e-af0a-969966521176 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[242f3ae8-a971-42ba-a453-cc8be58a417e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] <== disconnect_volume: return (285ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.193s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:49:54 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:49:54 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a001205e-3eee-42a8-bed9-682c88b48cfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:49:54 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7751c958-4eb9-4384-b4c1-2cf26e961d4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba] added
Nov 13 17:49:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca459d2-8a4c-4ff8-a017-a9e636b6c510]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78b13e8-4420-480f-a2fe-15b34a82bac3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QqSLulMD {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QqSLulMD" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[442dbf28-029e-4874-9bcc-e823887c1b00]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QqSLulMD'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a056d396-cd95-4754-8c20-2bd8501b20e1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c740def-3e4a-449d-a100-3ce1ce9a0575]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:49:54 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:49:54 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:49:54 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 17:49:54 user nova-compute[75100]: 
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[62127426-9480-4218-b284-1d5415b014e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba, portal: 172.16.0.220,3260]
Nov 13 17:49:54 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba, portal: 172.16.0.220,3260] successful.
Nov 13 17:49:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3053c8c-56fa-4c79-a3f5-1ec0b2c54b5e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4f9738-5f33-49cc-8036-6ab2bd77fd6c]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba (non-flash)
Nov 13 17:49:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba (non-flash)
Nov 13 17:49:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5e6720-f06c-4864-977a-2d590a14c79c]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqSLulMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG nova.objects.instance [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'flavor' on Instance uuid 165155e1-d159-4320-b12f-51dfb6e3e937 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:49:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-19984be1-3ddb-4cdb-babd-51fa21b3b102 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "165155e1-d159-4320-b12f-51dfb6e3e937" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:49:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:49:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '23762306164366466', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:49:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762306164366466', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:49:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lazy-loading 'flavor' on Instance uuid e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:49:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:49:55 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:49:55 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:49:55 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:49:55 user nova-compute[75100]:   <serial>f073c85e-df54-468b-8273-73c0977f81ba</serial>
Nov 13 17:49:55 user nova-compute[75100]: </disk>
Nov 13 17:49:55 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:49:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:49:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:49:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] No VIF found with MAC fa:16:3e:58:b9:4b, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:49:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-47b7a738-c780-4d8b-8c8d-497016d2b8b2 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.404s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:49:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:49:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:04 user nova-compute[75100]: INFO nova.compute.manager [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Detaching volume f073c85e-df54-468b-8273-73c0977f81ba
Nov 13 17:50:04 user nova-compute[75100]: INFO nova.virt.block_device [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Attempting to driver detach volume f073c85e-df54-468b-8273-73c0977f81ba from mountpoint /dev/vdb
Nov 13 17:50:04 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:50:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Attempting to detach device vdb from instance e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:50:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:50:04 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:50:04 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:50:04 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:50:04 user nova-compute[75100]:   <serial>f073c85e-df54-468b-8273-73c0977f81ba</serial>
Nov 13 17:50:04 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:50:04 user nova-compute[75100]: </disk>
Nov 13 17:50:04 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:50:04 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Successfully detached device vdb from instance e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a from the persistent domain config.
Nov 13 17:50:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:50:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:50:04 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:50:04 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:50:04 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:50:04 user nova-compute[75100]:   <serial>f073c85e-df54-468b-8273-73c0977f81ba</serial>
Nov 13 17:50:04 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:50:04 user nova-compute[75100]: </disk>
Nov 13 17:50:04 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:50:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:50:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:50:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:50:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:50:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:50:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:50:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:50:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "165155e1-d159-4320-b12f-51dfb6e3e937" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "165155e1-d159-4320-b12f-51dfb6e3e937" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:23 user nova-compute[75100]: INFO nova.compute.manager [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Terminating instance
Nov 13 17:50:23 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-a3b2b4bb-f00b-46e8-9ee0-7064dcd002ed req-becdacf4-5bc8-483a-b8ac-654ee445b682 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Received event network-vif-unplugged-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a3b2b4bb-f00b-46e8-9ee0-7064dcd002ed req-becdacf4-5bc8-483a-b8ac-654ee445b682 service nova] Acquiring lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a3b2b4bb-f00b-46e8-9ee0-7064dcd002ed req-becdacf4-5bc8-483a-b8ac-654ee445b682 service nova] Lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a3b2b4bb-f00b-46e8-9ee0-7064dcd002ed req-becdacf4-5bc8-483a-b8ac-654ee445b682 service nova] Lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-a3b2b4bb-f00b-46e8-9ee0-7064dcd002ed req-becdacf4-5bc8-483a-b8ac-654ee445b682 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] No waiting events found dispatching network-vif-unplugged-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:50:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-a3b2b4bb-f00b-46e8-9ee0-7064dcd002ed req-becdacf4-5bc8-483a-b8ac-654ee445b682 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Received event network-vif-unplugged-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Instance destroyed successfully.
Nov 13 17:50:24 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lazy-loading 'resources' on Instance uuid 165155e1-d159-4320-b12f-51dfb6e3e937 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:47:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1079382605',display_name='tempest-AttachVolumeNegativeTest-server-1079382605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1079382605',id=47,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYlX2xfI+YGnJike6qkbMM8Z45jH2L0DfktnNQMoEp3qC9e2MFJoAVaFyBnKH/Q4oBVIgHI9yGxKxEIluMKKjP5NMmReRHM1etbiOGt8yclaRy4Ikf+kN9Wlx4KnKhK5A==',key_name='tempest-keypair-900436917',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:47:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6352bffe5fa144f996e2ba07f69f4ee4',ramdisk_id='',reservation_id='r-m17j0rh7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2126330685',owner_user_name='tempest-AttachVolumeNegativeTest-2126330685-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9fde156049464deba4b3a3125712baa9',uuid=165155e1-d159-4320-b12f-51dfb6e3e937,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converting VIF {"id": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "address": "fa:16:3e:af:f7:30", "network": {"id": "3b1f0165-ca54-458a-b282-a900c09263ba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1781134774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6352bffe5fa144f996e2ba07f69f4ee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce2cfcd4-fd", "ovs_interfaceid": "ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:f7:30,bridge_name='br-int',has_traffic_filtering=True,id=ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2cfcd4-fd') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG os_vif [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:f7:30,bridge_name='br-int',has_traffic_filtering=True,id=ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2cfcd4-fd') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce2cfcd4-fd, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b39b4ce7-f719-4682-8937-f7fa3734b2ab) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:50:24 user nova-compute[75100]: INFO os_vif [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:f7:30,bridge_name='br-int',has_traffic_filtering=True,id=ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5,network=Network(3b1f0165-ca54-458a-b282-a900c09263ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce2cfcd4-fd')
Nov 13 17:50:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Deleting instance files /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937_del
Nov 13 17:50:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Deletion of /opt/stack/data/nova/instances/165155e1-d159-4320-b12f-51dfb6e3e937_del complete
Nov 13 17:50:24 user nova-compute[75100]: INFO nova.compute.manager [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:50:24 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a is timed out.
Nov 13 17:50:24 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Successfully detached device vdb from instance e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a from the live domain config.
Nov 13 17:50:24 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqSLulMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:50:24 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:50:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5e4178-c9e9-4b13-8148-d40661c8c1d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:50:24 user nova-compute[75100]: No targets found.
Nov 13 17:50:24 user nova-compute[75100]: iSNS:
Nov 13 17:50:24 user nova-compute[75100]: No targets found.
Nov 13 17:50:24 user nova-compute[75100]: STATIC:
Nov 13 17:50:24 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba
Nov 13 17:50:24 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:50:24 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:50:24 user nova-compute[75100]: FIRMWARE:
Nov 13 17:50:24 user nova-compute[75100]: No targets found.
Nov 13 17:50:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:50:24 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:50:24 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98f1d85-2c2e-4bd2-b7f6-ebb8b96f9f77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eea0f9-75d4-4091-88c6-10d18451ce9b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba (non-flash)
Nov 13 17:50:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba (non-flash)
Nov 13 17:50:24 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c506320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ee7c42-0c97-41e0-9a3b-bb19267281ff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d0ae93-7bb7-47b2-85ab-bb042aa31515]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:50:24 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7204e2c4-8dd6-4bbd-a682-d2bf1540bfe1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff52deed-f37c-4e8f-b931-17b604d5d5c1]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef306816-66fa-4316-b113-587982e58543]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:50:25 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Took 0.68 seconds to deallocate network for instance.
Nov 13 17:50:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-15f1843a-04c3-4c34-a646-b368bf198839 req-e07de70e-d3a7-4dd4-8cb4-6d54196aa7e7 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Received event network-vif-deleted-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:50:25 user nova-compute[75100]: INFO nova.compute.manager [req-15f1843a-04c3-4c34-a646-b368bf198839 req-e07de70e-d3a7-4dd4-8cb4-6d54196aa7e7 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Neutron deleted interface ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5; detaching it from the instance and deleting it from the info cache
Nov 13 17:50:25 user nova-compute[75100]: DEBUG nova.network.neutron [req-15f1843a-04c3-4c34-a646-b368bf198839 req-e07de70e-d3a7-4dd4-8cb4-6d54196aa7e7 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9b7027-e6b3-498a-a627-92daa5e638e7]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba, portal: 172.16.0.220,3260]
Nov 13 17:50:25 user nova-compute[75100]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba, portal: 172.16.0.220,3260] successful.
Nov 13 17:50:25 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-15f1843a-04c3-4c34-a646-b368bf198839 req-e07de70e-d3a7-4dd4-8cb4-6d54196aa7e7 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Detach interface failed, port_id=ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5, reason: Instance 165155e1-d159-4320-b12f-51dfb6e3e937 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4ed3ae-df62-491e-91c7-81fed62cc87e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] <== disconnect_volume: return (304ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:25 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Deleted allocations for instance 165155e1-d159-4320-b12f-51dfb6e3e937
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c92b9622-fb7f-414c-b7f8-d7266cc8c9b3 tempest-AttachVolumeNegativeTest-2126330685 tempest-AttachVolumeNegativeTest-2126330685-project-member] Lock "165155e1-d159-4320-b12f-51dfb6e3e937" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.883s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lazy-loading 'flavor' on Instance uuid e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5812d25d-300b-406d-87f5-47e643c66714 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.599s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.481s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:25 user nova-compute[75100]: INFO nova.compute.manager [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Terminating instance
Nov 13 17:50:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-592f3e34-e390-4a8c-a065-69a0606714ca req-191487ad-112c-4cad-a1cd-c5b8cf824ab0 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Received event network-vif-plugged-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-592f3e34-e390-4a8c-a065-69a0606714ca req-191487ad-112c-4cad-a1cd-c5b8cf824ab0 service nova] Acquiring lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-592f3e34-e390-4a8c-a065-69a0606714ca req-191487ad-112c-4cad-a1cd-c5b8cf824ab0 service nova] Lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-592f3e34-e390-4a8c-a065-69a0606714ca req-191487ad-112c-4cad-a1cd-c5b8cf824ab0 service nova] Lock "165155e1-d159-4320-b12f-51dfb6e3e937-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-592f3e34-e390-4a8c-a065-69a0606714ca req-191487ad-112c-4cad-a1cd-c5b8cf824ab0 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] No waiting events found dispatching network-vif-plugged-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:50:25 user nova-compute[75100]: WARNING nova.compute.manager [req-592f3e34-e390-4a8c-a065-69a0606714ca req-191487ad-112c-4cad-a1cd-c5b8cf824ab0 service nova] [instance: 165155e1-d159-4320-b12f-51dfb6e3e937] Received unexpected event network-vif-plugged-ce2cfcd4-fd97-4724-b9c2-dcb37e8e1ff5 for instance with vm_state deleted and task_state None.
Nov 13 17:50:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Instance destroyed successfully.
Nov 13 17:50:26 user nova-compute[75100]: DEBUG nova.objects.instance [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lazy-loading 'resources' on Instance uuid e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:47:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1864914274',display_name='tempest-VolumesSnapshotTestJSON-instance-1864914274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1864914274',id=48,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwD01Y6oPqUq36R5dSj1eg1uxaE/mtBEf65yqmblXNfw7nZ3RMI6qlGFhZXr+N6KGT9Lnze4hm/CinyGUIZ9E6JeJWwZgjO6yC4/rxNAVXTzHsMJmjztlOHKR8z9bM5Bw==',key_name='tempest-keypair-1580968712',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:48:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17d095299b54496bae4390b9b462a8d9',ramdisk_id='',reservation_id='r-zosbm6v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1809692111',owner_user_name='tempest-VolumesSnapshotTestJSON-1809692111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:48:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059e22ba39774ecc93789262a27570a4',uuid=e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "address": "fa:16:3e:58:b9:4b", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73a3e43-d8", "ovs_interfaceid": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Converting VIF {"id": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "address": "fa:16:3e:58:b9:4b", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb73a3e43-d8", "ovs_interfaceid": "b73a3e43-d8de-4dbc-be57-609f5f5704fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:b9:4b,bridge_name='br-int',has_traffic_filtering=True,id=b73a3e43-d8de-4dbc-be57-609f5f5704fd,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73a3e43-d8') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG os_vif [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:b9:4b,bridge_name='br-int',has_traffic_filtering=True,id=b73a3e43-d8de-4dbc-be57-609f5f5704fd,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73a3e43-d8') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb73a3e43-d8, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d4ab567-e945-4f8a-b76d-8c6dbc0a452f) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:50:26 user nova-compute[75100]: INFO os_vif [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:b9:4b,bridge_name='br-int',has_traffic_filtering=True,id=b73a3e43-d8de-4dbc-be57-609f5f5704fd,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb73a3e43-d8')
Nov 13 17:50:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:f073c85e-df54-468b-8273-73c0977f81ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QqSLulMD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:50:26 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:50:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[0b8972f6-56dd-4363-955d-508bd463d25c]: Unexpected error while running command.
Nov 13 17:50:26 user nova-compute[75100]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 17:50:26 user nova-compute[75100]: Exit code: 21
Nov 13 17:50:26 user nova-compute[75100]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 17:50:26 user nova-compute[75100]: Stderr: '' {{(pid=85770) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 13 17:50:26 user nova-compute[75100]: Traceback (most recent call last):
Nov 13 17:50:26 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 13 17:50:26 user nova-compute[75100]:     ret = func(*f_args, **f_kwargs)
Nov 13 17:50:26 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 13 17:50:26 user nova-compute[75100]:     return func(*args, **kwargs)
Nov 13 17:50:26 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 13 17:50:26 user nova-compute[75100]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 13 17:50:26 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 13 17:50:26 user nova-compute[75100]:     return putils.execute(on_execute=on_execute,
Nov 13 17:50:26 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 13 17:50:26 user nova-compute[75100]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 13 17:50:26 user nova-compute[75100]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 13 17:50:26 user nova-compute[75100]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 17:50:26 user nova-compute[75100]: Exit code: 21
Nov 13 17:50:26 user nova-compute[75100]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 17:50:26 user nova-compute[75100]: Stderr: ''
Nov 13 17:50:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8972f6-56dd-4363-955d-508bd463d25c]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 13 17:50:26 user nova-compute[75100]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 17:50:26 user nova-compute[75100]: Exit code: 21
Nov 13 17:50:26 user nova-compute[75100]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 17:50:26 user nova-compute[75100]: Stderr: ''
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 13 17:50:26 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi 
Nov 13 17:50:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75100) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] <== disconnect_volume: return (29ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:50:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Deleting instance files /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a_del
Nov 13 17:50:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Deletion of /opt/stack/data/nova/instances/e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a_del complete
Nov 13 17:50:26 user nova-compute[75100]: INFO nova.compute.manager [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 17:50:26 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:50:26 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-0e623e22-027e-4b0b-b2ad-79fdfae55bb8 req-74ecf4f5-e7cc-433a-91cd-9ab357b4a6fc service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Received event network-vif-unplugged-b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0e623e22-027e-4b0b-b2ad-79fdfae55bb8 req-74ecf4f5-e7cc-433a-91cd-9ab357b4a6fc service nova] Acquiring lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0e623e22-027e-4b0b-b2ad-79fdfae55bb8 req-74ecf4f5-e7cc-433a-91cd-9ab357b4a6fc service nova] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0e623e22-027e-4b0b-b2ad-79fdfae55bb8 req-74ecf4f5-e7cc-433a-91cd-9ab357b4a6fc service nova] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-0e623e22-027e-4b0b-b2ad-79fdfae55bb8 req-74ecf4f5-e7cc-433a-91cd-9ab357b4a6fc service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] No waiting events found dispatching network-vif-unplugged-b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-0e623e22-027e-4b0b-b2ad-79fdfae55bb8 req-74ecf4f5-e7cc-433a-91cd-9ab357b4a6fc service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Received event network-vif-unplugged-b73a3e43-d8de-4dbc-be57-609f5f5704fd for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-0e623e22-027e-4b0b-b2ad-79fdfae55bb8 req-74ecf4f5-e7cc-433a-91cd-9ab357b4a6fc service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Received event network-vif-plugged-b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0e623e22-027e-4b0b-b2ad-79fdfae55bb8 req-74ecf4f5-e7cc-433a-91cd-9ab357b4a6fc service nova] Acquiring lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0e623e22-027e-4b0b-b2ad-79fdfae55bb8 req-74ecf4f5-e7cc-433a-91cd-9ab357b4a6fc service nova] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0e623e22-027e-4b0b-b2ad-79fdfae55bb8 req-74ecf4f5-e7cc-433a-91cd-9ab357b4a6fc service nova] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-0e623e22-027e-4b0b-b2ad-79fdfae55bb8 req-74ecf4f5-e7cc-433a-91cd-9ab357b4a6fc service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] No waiting events found dispatching network-vif-plugged-b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:50:27 user nova-compute[75100]: WARNING nova.compute.manager [req-0e623e22-027e-4b0b-b2ad-79fdfae55bb8 req-74ecf4f5-e7cc-433a-91cd-9ab357b4a6fc service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Received unexpected event network-vif-plugged-b73a3e43-d8de-4dbc-be57-609f5f5704fd for instance with vm_state active and task_state deleting.
Nov 13 17:50:27 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:50:27 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Took 0.66 seconds to deallocate network for instance.
Nov 13 17:50:27 user nova-compute[75100]: WARNING nova.volume.cinder [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Attachment 3dfd17eb-4c86-4a27-8dd8-43069ff51415 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3dfd17eb-4c86-4a27-8dd8-43069ff51415. (HTTP 404) (Request-ID: req-37c88f47-17b1-41f3-91e0-eec97e868536)
Nov 13 17:50:27 user nova-compute[75100]: INFO nova.compute.manager [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Took 0.03 seconds to detach 1 volumes for instance.
Nov 13 17:50:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:50:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:27 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Deleted allocations for instance e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a
Nov 13 17:50:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-66f5f912-ebf5-404d-8ff9-08e41713c9a3 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.883s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-e1a9a119-f253-4c57-81f0-8c0e69f97928 req-185880ff-9dd8-4e78-9dcb-6e98c34591a9 service nova] [instance: e2ca0e7a-1f1a-4add-b4c0-9c3a49f5696a] Received event network-vif-deleted-b73a3e43-d8de-4dbc-be57-609f5f5704fd {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:50:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:31 user nova-compute[75100]: INFO nova.compute.manager [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Unshelving
Nov 13 17:50:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'pci_requests' on Instance uuid 88ac770d-eefa-4c0c-86e7-2d50fd322d28 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:50:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'numa_topology' on Instance uuid 88ac770d-eefa-4c0c-86e7-2d50fd322d28 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:50:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:50:31 user nova-compute[75100]: INFO nova.compute.claims [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Claim successful on node user
Nov 13 17:50:32 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:50:32 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:50:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:32 user nova-compute[75100]: INFO nova.network.neutron [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updating port d535aaf8-4bce-4fdb-924b-a4fbb91d204b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 17:50:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:50:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquired lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:50:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:50:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-a64fb8df-43ca-4227-bf9f-82bebf39e7e7 req-366284fe-e4a7-4393-be9f-c82dd65cccaa service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-changed-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:50:32 user nova-compute[75100]: DEBUG nova.compute.manager [req-a64fb8df-43ca-4227-bf9f-82bebf39e7e7 req-366284fe-e4a7-4393-be9f-c82dd65cccaa service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Refreshing instance network info cache due to event network-changed-d535aaf8-4bce-4fdb-924b-a4fbb91d204b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:50:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a64fb8df-43ca-4227-bf9f-82bebf39e7e7 req-366284fe-e4a7-4393-be9f-c82dd65cccaa service nova] Acquiring lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:50:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updating instance_info_cache with network_info: [{"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:50:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Releasing lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:50:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:50:33 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Creating image(s)
Nov 13 17:50:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "/opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "/opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "/opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:33 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'trusted_certs' on Instance uuid 88ac770d-eefa-4c0c-86e7-2d50fd322d28 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:50:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a64fb8df-43ca-4227-bf9f-82bebf39e7e7 req-366284fe-e4a7-4393-be9f-c82dd65cccaa service nova] Acquired lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:50:33 user nova-compute[75100]: DEBUG nova.network.neutron [req-a64fb8df-43ca-4227-bf9f-82bebf39e7e7 req-366284fe-e4a7-4393-be9f-c82dd65cccaa service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Refreshing network info cache for port d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:50:33 user nova-compute[75100]: DEBUG nova.objects.base [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Object Instance<88ac770d-eefa-4c0c-86e7-2d50fd322d28> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:50:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "340aa4876384b67f7faafd9a4b1d331e20adf228" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "340aa4876384b67f7faafd9a4b1d331e20adf228" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228.part --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG nova.virt.images [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] 313c5107-2587-40d0-a32b-6653ecb2bf58 was qcow2, converting to raw {{(pid=75100) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG nova.privsep.utils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75100) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228.part /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228.converted {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-a64fb8df-43ca-4227-bf9f-82bebf39e7e7 req-366284fe-e4a7-4393-be9f-c82dd65cccaa service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updated VIF entry in instance network info cache for port d535aaf8-4bce-4fdb-924b-a4fbb91d204b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-a64fb8df-43ca-4227-bf9f-82bebf39e7e7 req-366284fe-e4a7-4393-be9f-c82dd65cccaa service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updating instance_info_cache with network_info: [{"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a64fb8df-43ca-4227-bf9f-82bebf39e7e7 req-366284fe-e4a7-4393-be9f-c82dd65cccaa service nova] Releasing lock "refresh_cache-88ac770d-eefa-4c0c-86e7-2d50fd322d28" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228.part /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228.converted" returned: 0 in 0.315s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228.converted --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "340aa4876384b67f7faafd9a4b1d331e20adf228" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.688s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228 --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "340aa4876384b67f7faafd9a4b1d331e20adf228" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "340aa4876384b67f7faafd9a4b1d331e20adf228" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:34 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228 --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228,backing_fmt=raw /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228,backing_fmt=raw /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk 1073741824" returned: 0 in 0.057s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "340aa4876384b67f7faafd9a4b1d331e20adf228" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228 --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:35 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'migration_context' on Instance uuid 88ac770d-eefa-4c0c-86e7-2d50fd322d28 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:50:35 user nova-compute[75100]: DEBUG nova.objects.base [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Object Instance<88ac770d-eefa-4c0c-86e7-2d50fd322d28> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:50:35 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Rebasing disk image.
Nov 13 17:50:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.168s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:35 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 -F raw /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 -F raw /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk" returned: 0 in 2.081s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Ensure instance console log exists: /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Start _get_guest_xml network_info=[{"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8dd76418314053fa2a2bc29c0802bf11',container_format='bare',created_at=2023-11-13T17:48:39Z,direct_url=<?>,disk_format='qcow2',id=313c5107-2587-40d0-a32b-6653ecb2bf58,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2137819338-shelved',owner='db67a12bfc7f48b380175a6871012f25',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T17:48:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:50:37 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:50:37 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8dd76418314053fa2a2bc29c0802bf11',container_format='bare',created_at=2023-11-13T17:48:39Z,direct_url=<?>,disk_format='qcow2',id=313c5107-2587-40d0-a32b-6653ecb2bf58,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2137819338-shelved',owner='db67a12bfc7f48b380175a6871012f25',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T17:48:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'vcpu_model' on Instance uuid 88ac770d-eefa-4c0c-86e7-2d50fd322d28 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.objects.base [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Object Instance<88ac770d-eefa-4c0c-86e7-2d50fd322d28> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2137819338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2137819338',id=46,image_ref='313c5107-2587-40d0-a32b-6653ecb2bf58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-143936512',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:46:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='db67a12bfc7f48b380175a6871012f25',ramdisk_id='',reservation_id='r-n3ft0jyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1414200693',owner_user_name='tempest-AttachVolumeShelveTestJSON-1414200693-project-member',shelved_at='2023-11-13T17:48:43.017450',shelved_host='user',shelved_image_id='313c5107-2587-40d0-a32b-6653ecb2bf58'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:50:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54440f660c64141ad91285ddef65ca9',uuid=88ac770d-eefa-4c0c-86e7-2d50fd322d28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converting VIF {"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'pci_devices' on Instance uuid 88ac770d-eefa-4c0c-86e7-2d50fd322d28 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.objects.base [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Object Instance<88ac770d-eefa-4c0c-86e7-2d50fd322d28> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:50:37 user nova-compute[75100]:   <uuid>88ac770d-eefa-4c0c-86e7-2d50fd322d28</uuid>
Nov 13 17:50:37 user nova-compute[75100]:   <name>instance-0000002e</name>
Nov 13 17:50:37 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:50:37 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:50:37 user nova-compute[75100]:   <metadata>
Nov 13 17:50:37 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:50:37 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:50:37 user nova-compute[75100]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2137819338</nova:name>
Nov 13 17:50:37 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:50:37</nova:creationTime>
Nov 13 17:50:37 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:50:37 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:50:37 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:50:37 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:50:37 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:50:37 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:50:37 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:50:37 user nova-compute[75100]:       <nova:owner>
Nov 13 17:50:37 user nova-compute[75100]:         <nova:user uuid="c54440f660c64141ad91285ddef65ca9">tempest-AttachVolumeShelveTestJSON-1414200693-project-member</nova:user>
Nov 13 17:50:37 user nova-compute[75100]:         <nova:project uuid="db67a12bfc7f48b380175a6871012f25">tempest-AttachVolumeShelveTestJSON-1414200693</nova:project>
Nov 13 17:50:37 user nova-compute[75100]:       </nova:owner>
Nov 13 17:50:37 user nova-compute[75100]:       <nova:root type="image" uuid="313c5107-2587-40d0-a32b-6653ecb2bf58"/>
Nov 13 17:50:37 user nova-compute[75100]:       <nova:ports>
Nov 13 17:50:37 user nova-compute[75100]:         <nova:port uuid="d535aaf8-4bce-4fdb-924b-a4fbb91d204b">
Nov 13 17:50:37 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 17:50:37 user nova-compute[75100]:         </nova:port>
Nov 13 17:50:37 user nova-compute[75100]:       </nova:ports>
Nov 13 17:50:37 user nova-compute[75100]:     </nova:instance>
Nov 13 17:50:37 user nova-compute[75100]:   </metadata>
Nov 13 17:50:37 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:50:37 user nova-compute[75100]:     <system>
Nov 13 17:50:37 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:50:37 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:50:37 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:50:37 user nova-compute[75100]:       <entry name="serial">88ac770d-eefa-4c0c-86e7-2d50fd322d28</entry>
Nov 13 17:50:37 user nova-compute[75100]:       <entry name="uuid">88ac770d-eefa-4c0c-86e7-2d50fd322d28</entry>
Nov 13 17:50:37 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:50:37 user nova-compute[75100]:     </system>
Nov 13 17:50:37 user nova-compute[75100]:   </sysinfo>
Nov 13 17:50:37 user nova-compute[75100]:   <os>
Nov 13 17:50:37 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:50:37 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:50:37 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:50:37 user nova-compute[75100]:   </os>
Nov 13 17:50:37 user nova-compute[75100]:   <features>
Nov 13 17:50:37 user nova-compute[75100]:     <acpi/>
Nov 13 17:50:37 user nova-compute[75100]:     <apic/>
Nov 13 17:50:37 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:50:37 user nova-compute[75100]:   </features>
Nov 13 17:50:37 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:50:37 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:50:37 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:50:37 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:50:37 user nova-compute[75100]:   </clock>
Nov 13 17:50:37 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:50:37 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:50:37 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:50:37 user nova-compute[75100]:   </cpu>
Nov 13 17:50:37 user nova-compute[75100]:   <devices>
Nov 13 17:50:37 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:50:37 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:50:37 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk"/>
Nov 13 17:50:37 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:50:37 user nova-compute[75100]:     </disk>
Nov 13 17:50:37 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:50:37 user nova-compute[75100]:       <mac address="fa:16:3e:b5:32:a1"/>
Nov 13 17:50:37 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:50:37 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:50:37 user nova-compute[75100]:       <target dev="tapd535aaf8-4b"/>
Nov 13 17:50:37 user nova-compute[75100]:     </interface>
Nov 13 17:50:37 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:50:37 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/console.log" append="off"/>
Nov 13 17:50:37 user nova-compute[75100]:     </serial>
Nov 13 17:50:37 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:50:37 user nova-compute[75100]:     <video>
Nov 13 17:50:37 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:50:37 user nova-compute[75100]:     </video>
Nov 13 17:50:37 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:50:37 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:50:37 user nova-compute[75100]:     </rng>
Nov 13 17:50:37 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:50:37 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:50:37 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:50:37 user nova-compute[75100]:     </memballoon>
Nov 13 17:50:37 user nova-compute[75100]:   </devices>
Nov 13 17:50:37 user nova-compute[75100]: </domain>
Nov 13 17:50:37 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2137819338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2137819338',id=46,image_ref='313c5107-2587-40d0-a32b-6653ecb2bf58',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-143936512',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:46:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='db67a12bfc7f48b380175a6871012f25',ramdisk_id='',reservation_id='r-n3ft0jyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1414200693',owner_user_name='tempest-AttachVolumeShelveTestJSON-1414200693-project-member',shelved_at='2023-11-13T17:48:43.017450',shelved_host='user',shelved_image_id='313c5107-2587-40d0-a32b-6653ecb2bf58'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:50:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54440f660c64141ad91285ddef65ca9',uuid=88ac770d-eefa-4c0c-86e7-2d50fd322d28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converting VIF {"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG os_vif [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbb09b6d-6b33-5c70-b31f-a49c6ed68f6a', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd535aaf8-4b, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd535aaf8-4b, col_values=(('qos', UUID('fddb49b1-b6e0-431c-aa08-318864442f8f')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd535aaf8-4b, col_values=(('external_ids', {'iface-id': 'd535aaf8-4bce-4fdb-924b-a4fbb91d204b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:32:a1', 'vm-uuid': '88ac770d-eefa-4c0c-86e7-2d50fd322d28'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:37 user nova-compute[75100]: INFO os_vif [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b')
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:50:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] No VIF found with MAC fa:16:3e:b5:32:a1, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:50:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-183be651-6188-433e-ac82-e8a25ed56d07 req-f4ad2f97-6b77-4d7a-814f-3c8d457cf2a0 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:50:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-183be651-6188-433e-ac82-e8a25ed56d07 req-f4ad2f97-6b77-4d7a-814f-3c8d457cf2a0 service nova] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-183be651-6188-433e-ac82-e8a25ed56d07 req-f4ad2f97-6b77-4d7a-814f-3c8d457cf2a0 service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:39 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-183be651-6188-433e-ac82-e8a25ed56d07 req-f4ad2f97-6b77-4d7a-814f-3c8d457cf2a0 service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:39 user nova-compute[75100]: DEBUG nova.compute.manager [req-183be651-6188-433e-ac82-e8a25ed56d07 req-f4ad2f97-6b77-4d7a-814f-3c8d457cf2a0 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] No waiting events found dispatching network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:50:39 user nova-compute[75100]: WARNING nova.compute.manager [req-183be651-6188-433e-ac82-e8a25ed56d07 req-f4ad2f97-6b77-4d7a-814f-3c8d457cf2a0 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received unexpected event network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 17:50:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:50:41 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:50:41 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Instance spawned successfully.
Nov 13 17:50:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-e937ff8f-d1e3-478a-a6e6-dea706e70287 req-0366d3c2-5e66-430d-8d05-db8b7733aaa7 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:50:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e937ff8f-d1e3-478a-a6e6-dea706e70287 req-0366d3c2-5e66-430d-8d05-db8b7733aaa7 service nova] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e937ff8f-d1e3-478a-a6e6-dea706e70287 req-0366d3c2-5e66-430d-8d05-db8b7733aaa7 service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e937ff8f-d1e3-478a-a6e6-dea706e70287 req-0366d3c2-5e66-430d-8d05-db8b7733aaa7 service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:41 user nova-compute[75100]: DEBUG nova.compute.manager [req-e937ff8f-d1e3-478a-a6e6-dea706e70287 req-0366d3c2-5e66-430d-8d05-db8b7733aaa7 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] No waiting events found dispatching network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:50:41 user nova-compute[75100]: WARNING nova.compute.manager [req-e937ff8f-d1e3-478a-a6e6-dea706e70287 req-0366d3c2-5e66-430d-8d05-db8b7733aaa7 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received unexpected event network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 17:50:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:50:41 user nova-compute[75100]: DEBUG nova.compute.manager [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:50:41 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-bed675ee-bfa0-40dd-8410-ef412259575e tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.751s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:50:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:50:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:50:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:50:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 17:50:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:50:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:50:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:50:44 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:50:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:50:45 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:50:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=25.065982818603516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 88ac770d-eefa-4c0c-86e7-2d50fd322d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing inventories for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating ProviderTree inventory for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating inventory in ProviderTree for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing aggregate associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing trait associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:50:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:50:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:50:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:50:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:50:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:50:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:50:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 17:50:48 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 17:50:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:50:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:50:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:50:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:50:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:50:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:50:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:50:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:50:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:51:03 user nova-compute[75100]: INFO nova.compute.claims [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Claim successful on node user
Nov 13 17:51:03 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG nova.network.neutron [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:51:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:51:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG nova.policy [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '059e22ba39774ecc93789262a27570a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17d095299b54496bae4390b9b462a8d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:51:03 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Creating image(s)
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "/opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "/opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "/opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:51:03 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.192s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk 1073741824" returned: 0 in 0.052s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG nova.network.neutron [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Successfully created port: 10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.185s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Cannot resize image /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Ensure instance console log exists: /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:51:04 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.network.neutron [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Successfully updated port: 10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "refresh_cache-b26889eb-fbdf-4493-aa96-88ee75b33a00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquired lock "refresh_cache-b26889eb-fbdf-4493-aa96-88ee75b33a00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.network.neutron [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-56acf5d8-f67d-4c19-a616-c63c8884988e req-f3f407d0-22c2-4f7f-91f7-ad0c6776bea7 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Received event network-changed-10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.compute.manager [req-56acf5d8-f67d-4c19-a616-c63c8884988e req-f3f407d0-22c2-4f7f-91f7-ad0c6776bea7 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Refreshing instance network info cache due to event network-changed-10842f42-2861-476a-a5d9-31ad3412b516. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-56acf5d8-f67d-4c19-a616-c63c8884988e req-f3f407d0-22c2-4f7f-91f7-ad0c6776bea7 service nova] Acquiring lock "refresh_cache-b26889eb-fbdf-4493-aa96-88ee75b33a00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.network.neutron [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.network.neutron [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Updating instance_info_cache with network_info: [{"id": "10842f42-2861-476a-a5d9-31ad3412b516", "address": "fa:16:3e:b6:4a:c8", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10842f42-28", "ovs_interfaceid": "10842f42-2861-476a-a5d9-31ad3412b516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Releasing lock "refresh_cache-b26889eb-fbdf-4493-aa96-88ee75b33a00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Instance network_info: |[{"id": "10842f42-2861-476a-a5d9-31ad3412b516", "address": "fa:16:3e:b6:4a:c8", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10842f42-28", "ovs_interfaceid": "10842f42-2861-476a-a5d9-31ad3412b516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-56acf5d8-f67d-4c19-a616-c63c8884988e req-f3f407d0-22c2-4f7f-91f7-ad0c6776bea7 service nova] Acquired lock "refresh_cache-b26889eb-fbdf-4493-aa96-88ee75b33a00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.network.neutron [req-56acf5d8-f67d-4c19-a616-c63c8884988e req-f3f407d0-22c2-4f7f-91f7-ad0c6776bea7 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Refreshing network info cache for port 10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Start _get_guest_xml network_info=[{"id": "10842f42-2861-476a-a5d9-31ad3412b516", "address": "fa:16:3e:b6:4a:c8", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10842f42-28", "ovs_interfaceid": "10842f42-2861-476a-a5d9-31ad3412b516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:51:05 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:51:05 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1877836019',display_name='tempest-VolumesSnapshotTestJSON-instance-1877836019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1877836019',id=49,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmMYsTfVqvjBp8WSFM/vRY6DgmQroa3xOaIGfBPq3IF0+xD/mXhwn/FT9yjBieMoFtPcRzRd7LFT5CVu/mZClZfFWD7CvYx7Fpr/0g9PN4uGq2bIUiLpAI5D4LC2XTW7g==',key_name='tempest-keypair-1644379708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17d095299b54496bae4390b9b462a8d9',ramdisk_id='',reservation_id='r-rj2i4ahc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1809692111',owner_user_name='tempest-VolumesSnapshotTestJSON-1809692111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059e22ba39774ecc93789262a27570a4',uuid=b26889eb-fbdf-4493-aa96-88ee75b33a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10842f42-2861-476a-a5d9-31ad3412b516", "address": "fa:16:3e:b6:4a:c8", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10842f42-28", "ovs_interfaceid": "10842f42-2861-476a-a5d9-31ad3412b516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Converting VIF {"id": "10842f42-2861-476a-a5d9-31ad3412b516", "address": "fa:16:3e:b6:4a:c8", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10842f42-28", "ovs_interfaceid": "10842f42-2861-476a-a5d9-31ad3412b516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=10842f42-2861-476a-a5d9-31ad3412b516,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10842f42-28') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.objects.instance [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lazy-loading 'pci_devices' on Instance uuid b26889eb-fbdf-4493-aa96-88ee75b33a00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:51:05 user nova-compute[75100]:   <uuid>b26889eb-fbdf-4493-aa96-88ee75b33a00</uuid>
Nov 13 17:51:05 user nova-compute[75100]:   <name>instance-00000031</name>
Nov 13 17:51:05 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:51:05 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:51:05 user nova-compute[75100]:   <metadata>
Nov 13 17:51:05 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:51:05 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:51:05 user nova-compute[75100]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1877836019</nova:name>
Nov 13 17:51:05 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:51:05</nova:creationTime>
Nov 13 17:51:05 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:51:05 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:51:05 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:51:05 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:51:05 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:51:05 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:51:05 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:51:05 user nova-compute[75100]:       <nova:owner>
Nov 13 17:51:05 user nova-compute[75100]:         <nova:user uuid="059e22ba39774ecc93789262a27570a4">tempest-VolumesSnapshotTestJSON-1809692111-project-member</nova:user>
Nov 13 17:51:05 user nova-compute[75100]:         <nova:project uuid="17d095299b54496bae4390b9b462a8d9">tempest-VolumesSnapshotTestJSON-1809692111</nova:project>
Nov 13 17:51:05 user nova-compute[75100]:       </nova:owner>
Nov 13 17:51:05 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:51:05 user nova-compute[75100]:       <nova:ports>
Nov 13 17:51:05 user nova-compute[75100]:         <nova:port uuid="10842f42-2861-476a-a5d9-31ad3412b516">
Nov 13 17:51:05 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 17:51:05 user nova-compute[75100]:         </nova:port>
Nov 13 17:51:05 user nova-compute[75100]:       </nova:ports>
Nov 13 17:51:05 user nova-compute[75100]:     </nova:instance>
Nov 13 17:51:05 user nova-compute[75100]:   </metadata>
Nov 13 17:51:05 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:51:05 user nova-compute[75100]:     <system>
Nov 13 17:51:05 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:51:05 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:51:05 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:51:05 user nova-compute[75100]:       <entry name="serial">b26889eb-fbdf-4493-aa96-88ee75b33a00</entry>
Nov 13 17:51:05 user nova-compute[75100]:       <entry name="uuid">b26889eb-fbdf-4493-aa96-88ee75b33a00</entry>
Nov 13 17:51:05 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:51:05 user nova-compute[75100]:     </system>
Nov 13 17:51:05 user nova-compute[75100]:   </sysinfo>
Nov 13 17:51:05 user nova-compute[75100]:   <os>
Nov 13 17:51:05 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:51:05 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:51:05 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:51:05 user nova-compute[75100]:   </os>
Nov 13 17:51:05 user nova-compute[75100]:   <features>
Nov 13 17:51:05 user nova-compute[75100]:     <acpi/>
Nov 13 17:51:05 user nova-compute[75100]:     <apic/>
Nov 13 17:51:05 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:51:05 user nova-compute[75100]:   </features>
Nov 13 17:51:05 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:51:05 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:51:05 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:51:05 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:51:05 user nova-compute[75100]:   </clock>
Nov 13 17:51:05 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:51:05 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:51:05 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:51:05 user nova-compute[75100]:   </cpu>
Nov 13 17:51:05 user nova-compute[75100]:   <devices>
Nov 13 17:51:05 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:51:05 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:51:05 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk"/>
Nov 13 17:51:05 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:51:05 user nova-compute[75100]:     </disk>
Nov 13 17:51:05 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:51:05 user nova-compute[75100]:       <mac address="fa:16:3e:b6:4a:c8"/>
Nov 13 17:51:05 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:51:05 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:51:05 user nova-compute[75100]:       <target dev="tap10842f42-28"/>
Nov 13 17:51:05 user nova-compute[75100]:     </interface>
Nov 13 17:51:05 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:51:05 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/console.log" append="off"/>
Nov 13 17:51:05 user nova-compute[75100]:     </serial>
Nov 13 17:51:05 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:51:05 user nova-compute[75100]:     <video>
Nov 13 17:51:05 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:51:05 user nova-compute[75100]:     </video>
Nov 13 17:51:05 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:51:05 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:51:05 user nova-compute[75100]:     </rng>
Nov 13 17:51:05 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:51:05 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:51:05 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:51:05 user nova-compute[75100]:     </memballoon>
Nov 13 17:51:05 user nova-compute[75100]:   </devices>
Nov 13 17:51:05 user nova-compute[75100]: </domain>
Nov 13 17:51:05 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1877836019',display_name='tempest-VolumesSnapshotTestJSON-instance-1877836019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1877836019',id=49,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmMYsTfVqvjBp8WSFM/vRY6DgmQroa3xOaIGfBPq3IF0+xD/mXhwn/FT9yjBieMoFtPcRzRd7LFT5CVu/mZClZfFWD7CvYx7Fpr/0g9PN4uGq2bIUiLpAI5D4LC2XTW7g==',key_name='tempest-keypair-1644379708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='17d095299b54496bae4390b9b462a8d9',ramdisk_id='',reservation_id='r-rj2i4ahc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1809692111',owner_user_name='tempest-VolumesSnapshotTestJSON-1809692111-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:51:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059e22ba39774ecc93789262a27570a4',uuid=b26889eb-fbdf-4493-aa96-88ee75b33a00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10842f42-2861-476a-a5d9-31ad3412b516", "address": "fa:16:3e:b6:4a:c8", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10842f42-28", "ovs_interfaceid": "10842f42-2861-476a-a5d9-31ad3412b516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Converting VIF {"id": "10842f42-2861-476a-a5d9-31ad3412b516", "address": "fa:16:3e:b6:4a:c8", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10842f42-28", "ovs_interfaceid": "10842f42-2861-476a-a5d9-31ad3412b516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=10842f42-2861-476a-a5d9-31ad3412b516,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10842f42-28') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG os_vif [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=10842f42-2861-476a-a5d9-31ad3412b516,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10842f42-28') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d036788-4b09-5db7-8f62-633675567770', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10842f42-28, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10842f42-28, col_values=(('qos', UUID('10ccdf84-5a34-4265-9d7e-d5582c915704')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10842f42-28, col_values=(('external_ids', {'iface-id': '10842f42-2861-476a-a5d9-31ad3412b516', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:4a:c8', 'vm-uuid': 'b26889eb-fbdf-4493-aa96-88ee75b33a00'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:05 user nova-compute[75100]: INFO os_vif [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=10842f42-2861-476a-a5d9-31ad3412b516,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10842f42-28')
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] No VIF found with MAC fa:16:3e:b6:4a:c8, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.network.neutron [req-56acf5d8-f67d-4c19-a616-c63c8884988e req-f3f407d0-22c2-4f7f-91f7-ad0c6776bea7 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Updated VIF entry in instance network info cache for port 10842f42-2861-476a-a5d9-31ad3412b516. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG nova.network.neutron [req-56acf5d8-f67d-4c19-a616-c63c8884988e req-f3f407d0-22c2-4f7f-91f7-ad0c6776bea7 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Updating instance_info_cache with network_info: [{"id": "10842f42-2861-476a-a5d9-31ad3412b516", "address": "fa:16:3e:b6:4a:c8", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10842f42-28", "ovs_interfaceid": "10842f42-2861-476a-a5d9-31ad3412b516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:51:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-56acf5d8-f67d-4c19-a616-c63c8884988e req-f3f407d0-22c2-4f7f-91f7-ad0c6776bea7 service nova] Releasing lock "refresh_cache-b26889eb-fbdf-4493-aa96-88ee75b33a00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:51:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-adf27df0-594a-433c-bb71-7607351654f9 req-6d2e2f8e-b753-4c3f-ace6-4ab2e028d3a6 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Received event network-vif-plugged-10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:51:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-adf27df0-594a-433c-bb71-7607351654f9 req-6d2e2f8e-b753-4c3f-ace6-4ab2e028d3a6 service nova] Acquiring lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:51:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-adf27df0-594a-433c-bb71-7607351654f9 req-6d2e2f8e-b753-4c3f-ace6-4ab2e028d3a6 service nova] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:51:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-adf27df0-594a-433c-bb71-7607351654f9 req-6d2e2f8e-b753-4c3f-ace6-4ab2e028d3a6 service nova] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:51:07 user nova-compute[75100]: DEBUG nova.compute.manager [req-adf27df0-594a-433c-bb71-7607351654f9 req-6d2e2f8e-b753-4c3f-ace6-4ab2e028d3a6 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] No waiting events found dispatching network-vif-plugged-10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:51:07 user nova-compute[75100]: WARNING nova.compute.manager [req-adf27df0-594a-433c-bb71-7607351654f9 req-6d2e2f8e-b753-4c3f-ace6-4ab2e028d3a6 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Received unexpected event network-vif-plugged-10842f42-2861-476a-a5d9-31ad3412b516 for instance with vm_state building and task_state spawning.
Nov 13 17:51:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:51:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:51:08 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Instance spawned successfully.
Nov 13 17:51:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:51:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:51:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:51:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:51:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:51:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:51:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:51:09 user nova-compute[75100]: INFO nova.compute.manager [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 13 17:51:09 user nova-compute[75100]: DEBUG nova.compute.manager [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:51:09 user nova-compute[75100]: INFO nova.compute.manager [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Took 6.01 seconds to build instance.
Nov 13 17:51:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-24abc693-8315-4034-8c45-74b95ab226fe tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.120s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:51:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-77396629-958c-40d9-9cb3-80dd34045bf2 req-c00d3f82-a2a2-4bd0-b2e2-5fe351923dd8 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Received event network-vif-plugged-10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:51:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-77396629-958c-40d9-9cb3-80dd34045bf2 req-c00d3f82-a2a2-4bd0-b2e2-5fe351923dd8 service nova] Acquiring lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:51:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-77396629-958c-40d9-9cb3-80dd34045bf2 req-c00d3f82-a2a2-4bd0-b2e2-5fe351923dd8 service nova] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:51:09 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-77396629-958c-40d9-9cb3-80dd34045bf2 req-c00d3f82-a2a2-4bd0-b2e2-5fe351923dd8 service nova] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:51:09 user nova-compute[75100]: DEBUG nova.compute.manager [req-77396629-958c-40d9-9cb3-80dd34045bf2 req-c00d3f82-a2a2-4bd0-b2e2-5fe351923dd8 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] No waiting events found dispatching network-vif-plugged-10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:51:09 user nova-compute[75100]: WARNING nova.compute.manager [req-77396629-958c-40d9-9cb3-80dd34045bf2 req-c00d3f82-a2a2-4bd0-b2e2-5fe351923dd8 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Received unexpected event network-vif-plugged-10842f42-2861-476a-a5d9-31ad3412b516 for instance with vm_state active and task_state None.
Nov 13 17:51:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:51:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 17:51:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:51:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:51:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-b26889eb-fbdf-4493-aa96-88ee75b33a00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-b26889eb-fbdf-4493-aa96-88ee75b33a00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid b26889eb-fbdf-4493-aa96-88ee75b33a00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Updating instance_info_cache with network_info: [{"id": "10842f42-2861-476a-a5d9-31ad3412b516", "address": "fa:16:3e:b6:4a:c8", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10842f42-28", "ovs_interfaceid": "10842f42-2861-476a-a5d9-31ad3412b516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-b26889eb-fbdf-4493-aa96-88ee75b33a00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:51:44 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:51:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:51:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:51:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:51:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:51:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:51:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:51:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:51:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:51:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:51:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:51:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=25.034378051757812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:51:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 88ac770d-eefa-4c0c-86e7-2d50fd322d28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:51:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b26889eb-fbdf-4493-aa96-88ee75b33a00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:51:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:51:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:51:46 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:51:46 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:51:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:51:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:51:46 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:51:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:51:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:51:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:51:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:51:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:51:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:51:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:51:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:51:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:51:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:51:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:52:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:52:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:52:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:52:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:52:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Acquiring lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:52:17 user nova-compute[75100]: INFO nova.compute.claims [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Claim successful on node user
Nov 13 17:52:17 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:52:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:52:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG nova.policy [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f824892c732e48e3a26b2e4a0fd0307e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3e890babfa1473fb7e7e0acccf8fb4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:52:17 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Creating image(s)
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "/opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "/opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:17 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk 1073741824" returned: 0 in 0.060s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Successfully created port: e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Cannot resize image /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Ensure instance console log exists: /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Successfully updated port: e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Acquiring lock "refresh_cache-1cfeb033-e57f-43b5-9dd5-5bdee2a68237" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Acquired lock "refresh_cache-1cfeb033-e57f-43b5-9dd5-5bdee2a68237" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-87e9a5eb-2cca-4c27-968d-ec833de9c447 req-0eb2fd62-0538-4835-b902-07bcd65d9c2f service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Received event network-changed-e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG nova.compute.manager [req-87e9a5eb-2cca-4c27-968d-ec833de9c447 req-0eb2fd62-0538-4835-b902-07bcd65d9c2f service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Refreshing instance network info cache due to event network-changed-e8662811-27db-4fec-b337-e96139359589. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:52:18 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-87e9a5eb-2cca-4c27-968d-ec833de9c447 req-0eb2fd62-0538-4835-b902-07bcd65d9c2f service nova] Acquiring lock "refresh_cache-1cfeb033-e57f-43b5-9dd5-5bdee2a68237" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.network.neutron [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Updating instance_info_cache with network_info: [{"id": "e8662811-27db-4fec-b337-e96139359589", "address": "fa:16:3e:95:13:63", "network": {"id": "2e43774a-c50f-4f1b-8904-214b6fac4949", "bridge": "br-int", "label": "tempest-VolumesActionsTest-497962766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e890babfa1473fb7e7e0acccf8fb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8662811-27", "ovs_interfaceid": "e8662811-27db-4fec-b337-e96139359589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Releasing lock "refresh_cache-1cfeb033-e57f-43b5-9dd5-5bdee2a68237" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Instance network_info: |[{"id": "e8662811-27db-4fec-b337-e96139359589", "address": "fa:16:3e:95:13:63", "network": {"id": "2e43774a-c50f-4f1b-8904-214b6fac4949", "bridge": "br-int", "label": "tempest-VolumesActionsTest-497962766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e890babfa1473fb7e7e0acccf8fb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8662811-27", "ovs_interfaceid": "e8662811-27db-4fec-b337-e96139359589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-87e9a5eb-2cca-4c27-968d-ec833de9c447 req-0eb2fd62-0538-4835-b902-07bcd65d9c2f service nova] Acquired lock "refresh_cache-1cfeb033-e57f-43b5-9dd5-5bdee2a68237" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-87e9a5eb-2cca-4c27-968d-ec833de9c447 req-0eb2fd62-0538-4835-b902-07bcd65d9c2f service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Refreshing network info cache for port e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Start _get_guest_xml network_info=[{"id": "e8662811-27db-4fec-b337-e96139359589", "address": "fa:16:3e:95:13:63", "network": {"id": "2e43774a-c50f-4f1b-8904-214b6fac4949", "bridge": "br-int", "label": "tempest-VolumesActionsTest-497962766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e890babfa1473fb7e7e0acccf8fb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8662811-27", "ovs_interfaceid": "e8662811-27db-4fec-b337-e96139359589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:52:19 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:52:19 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:52:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1472888854',display_name='tempest-VolumesActionsTest-instance-1472888854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1472888854',id=50,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e890babfa1473fb7e7e0acccf8fb4e',ramdisk_id='',reservation_id='r-z3ll3txv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-852444592',owner_user_name='tempest-VolumesActionsTest-852444592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:52:18Z,user_data=None,user_id='f824892c732e48e3a26b2e4a0fd0307e',uuid=1cfeb033-e57f-43b5-9dd5-5bdee2a68237,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8662811-27db-4fec-b337-e96139359589", "address": "fa:16:3e:95:13:63", "network": {"id": "2e43774a-c50f-4f1b-8904-214b6fac4949", "bridge": "br-int", "label": "tempest-VolumesActionsTest-497962766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e890babfa1473fb7e7e0acccf8fb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8662811-27", "ovs_interfaceid": "e8662811-27db-4fec-b337-e96139359589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Converting VIF {"id": "e8662811-27db-4fec-b337-e96139359589", "address": "fa:16:3e:95:13:63", "network": {"id": "2e43774a-c50f-4f1b-8904-214b6fac4949", "bridge": "br-int", "label": "tempest-VolumesActionsTest-497962766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e890babfa1473fb7e7e0acccf8fb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8662811-27", "ovs_interfaceid": "e8662811-27db-4fec-b337-e96139359589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:13:63,bridge_name='br-int',has_traffic_filtering=True,id=e8662811-27db-4fec-b337-e96139359589,network=Network(2e43774a-c50f-4f1b-8904-214b6fac4949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8662811-27') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cfeb033-e57f-43b5-9dd5-5bdee2a68237 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:52:19 user nova-compute[75100]:   <uuid>1cfeb033-e57f-43b5-9dd5-5bdee2a68237</uuid>
Nov 13 17:52:19 user nova-compute[75100]:   <name>instance-00000032</name>
Nov 13 17:52:19 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:52:19 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:52:19 user nova-compute[75100]:   <metadata>
Nov 13 17:52:19 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:52:19 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:52:19 user nova-compute[75100]:       <nova:name>tempest-VolumesActionsTest-instance-1472888854</nova:name>
Nov 13 17:52:19 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:52:19</nova:creationTime>
Nov 13 17:52:19 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:52:19 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:52:19 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:52:19 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:52:19 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:52:19 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:52:19 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:52:19 user nova-compute[75100]:       <nova:owner>
Nov 13 17:52:19 user nova-compute[75100]:         <nova:user uuid="f824892c732e48e3a26b2e4a0fd0307e">tempest-VolumesActionsTest-852444592-project-member</nova:user>
Nov 13 17:52:19 user nova-compute[75100]:         <nova:project uuid="b3e890babfa1473fb7e7e0acccf8fb4e">tempest-VolumesActionsTest-852444592</nova:project>
Nov 13 17:52:19 user nova-compute[75100]:       </nova:owner>
Nov 13 17:52:19 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:52:19 user nova-compute[75100]:       <nova:ports>
Nov 13 17:52:19 user nova-compute[75100]:         <nova:port uuid="e8662811-27db-4fec-b337-e96139359589">
Nov 13 17:52:19 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 17:52:19 user nova-compute[75100]:         </nova:port>
Nov 13 17:52:19 user nova-compute[75100]:       </nova:ports>
Nov 13 17:52:19 user nova-compute[75100]:     </nova:instance>
Nov 13 17:52:19 user nova-compute[75100]:   </metadata>
Nov 13 17:52:19 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:52:19 user nova-compute[75100]:     <system>
Nov 13 17:52:19 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:52:19 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:52:19 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:52:19 user nova-compute[75100]:       <entry name="serial">1cfeb033-e57f-43b5-9dd5-5bdee2a68237</entry>
Nov 13 17:52:19 user nova-compute[75100]:       <entry name="uuid">1cfeb033-e57f-43b5-9dd5-5bdee2a68237</entry>
Nov 13 17:52:19 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:52:19 user nova-compute[75100]:     </system>
Nov 13 17:52:19 user nova-compute[75100]:   </sysinfo>
Nov 13 17:52:19 user nova-compute[75100]:   <os>
Nov 13 17:52:19 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:52:19 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:52:19 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:52:19 user nova-compute[75100]:   </os>
Nov 13 17:52:19 user nova-compute[75100]:   <features>
Nov 13 17:52:19 user nova-compute[75100]:     <acpi/>
Nov 13 17:52:19 user nova-compute[75100]:     <apic/>
Nov 13 17:52:19 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:52:19 user nova-compute[75100]:   </features>
Nov 13 17:52:19 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:52:19 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:52:19 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:52:19 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:52:19 user nova-compute[75100]:   </clock>
Nov 13 17:52:19 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:52:19 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:52:19 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:52:19 user nova-compute[75100]:   </cpu>
Nov 13 17:52:19 user nova-compute[75100]:   <devices>
Nov 13 17:52:19 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:52:19 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:52:19 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk"/>
Nov 13 17:52:19 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:52:19 user nova-compute[75100]:     </disk>
Nov 13 17:52:19 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:52:19 user nova-compute[75100]:       <mac address="fa:16:3e:95:13:63"/>
Nov 13 17:52:19 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:52:19 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:52:19 user nova-compute[75100]:       <target dev="tape8662811-27"/>
Nov 13 17:52:19 user nova-compute[75100]:     </interface>
Nov 13 17:52:19 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:52:19 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/console.log" append="off"/>
Nov 13 17:52:19 user nova-compute[75100]:     </serial>
Nov 13 17:52:19 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:52:19 user nova-compute[75100]:     <video>
Nov 13 17:52:19 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:52:19 user nova-compute[75100]:     </video>
Nov 13 17:52:19 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:52:19 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:52:19 user nova-compute[75100]:     </rng>
Nov 13 17:52:19 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:52:19 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:52:19 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:52:19 user nova-compute[75100]:     </memballoon>
Nov 13 17:52:19 user nova-compute[75100]:   </devices>
Nov 13 17:52:19 user nova-compute[75100]: </domain>
Nov 13 17:52:19 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:52:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1472888854',display_name='tempest-VolumesActionsTest-instance-1472888854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1472888854',id=50,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3e890babfa1473fb7e7e0acccf8fb4e',ramdisk_id='',reservation_id='r-z3ll3txv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-852444592',owner_user_name='tempest-VolumesActionsTest-852444592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:52:18Z,user_data=None,user_id='f824892c732e48e3a26b2e4a0fd0307e',uuid=1cfeb033-e57f-43b5-9dd5-5bdee2a68237,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8662811-27db-4fec-b337-e96139359589", "address": "fa:16:3e:95:13:63", "network": {"id": "2e43774a-c50f-4f1b-8904-214b6fac4949", "bridge": "br-int", "label": "tempest-VolumesActionsTest-497962766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e890babfa1473fb7e7e0acccf8fb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8662811-27", "ovs_interfaceid": "e8662811-27db-4fec-b337-e96139359589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Converting VIF {"id": "e8662811-27db-4fec-b337-e96139359589", "address": "fa:16:3e:95:13:63", "network": {"id": "2e43774a-c50f-4f1b-8904-214b6fac4949", "bridge": "br-int", "label": "tempest-VolumesActionsTest-497962766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e890babfa1473fb7e7e0acccf8fb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8662811-27", "ovs_interfaceid": "e8662811-27db-4fec-b337-e96139359589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:13:63,bridge_name='br-int',has_traffic_filtering=True,id=e8662811-27db-4fec-b337-e96139359589,network=Network(2e43774a-c50f-4f1b-8904-214b6fac4949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8662811-27') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG os_vif [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:13:63,bridge_name='br-int',has_traffic_filtering=True,id=e8662811-27db-4fec-b337-e96139359589,network=Network(2e43774a-c50f-4f1b-8904-214b6fac4949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8662811-27') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed439f68-c23a-5be6-8608-c8ba05b8060a', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8662811-27, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8662811-27, col_values=(('qos', UUID('568e6300-db9e-4670-a1e8-5a799effd147')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8662811-27, col_values=(('external_ids', {'iface-id': 'e8662811-27db-4fec-b337-e96139359589', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:13:63', 'vm-uuid': '1cfeb033-e57f-43b5-9dd5-5bdee2a68237'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:19 user nova-compute[75100]: INFO os_vif [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:13:63,bridge_name='br-int',has_traffic_filtering=True,id=e8662811-27db-4fec-b337-e96139359589,network=Network(2e43774a-c50f-4f1b-8904-214b6fac4949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8662811-27')
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] No VIF found with MAC fa:16:3e:95:13:63, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-87e9a5eb-2cca-4c27-968d-ec833de9c447 req-0eb2fd62-0538-4835-b902-07bcd65d9c2f service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Updated VIF entry in instance network info cache for port e8662811-27db-4fec-b337-e96139359589. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-87e9a5eb-2cca-4c27-968d-ec833de9c447 req-0eb2fd62-0538-4835-b902-07bcd65d9c2f service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Updating instance_info_cache with network_info: [{"id": "e8662811-27db-4fec-b337-e96139359589", "address": "fa:16:3e:95:13:63", "network": {"id": "2e43774a-c50f-4f1b-8904-214b6fac4949", "bridge": "br-int", "label": "tempest-VolumesActionsTest-497962766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e890babfa1473fb7e7e0acccf8fb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8662811-27", "ovs_interfaceid": "e8662811-27db-4fec-b337-e96139359589", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:52:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-87e9a5eb-2cca-4c27-968d-ec833de9c447 req-0eb2fd62-0538-4835-b902-07bcd65d9c2f service nova] Releasing lock "refresh_cache-1cfeb033-e57f-43b5-9dd5-5bdee2a68237" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-10b5472d-e6f2-4c3e-900f-898ed63188d5 req-6bd2c8e6-9751-4f07-a9f7-985aa4d806f4 service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Received event network-vif-plugged-e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:52:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-10b5472d-e6f2-4c3e-900f-898ed63188d5 req-6bd2c8e6-9751-4f07-a9f7-985aa4d806f4 service nova] Acquiring lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-10b5472d-e6f2-4c3e-900f-898ed63188d5 req-6bd2c8e6-9751-4f07-a9f7-985aa4d806f4 service nova] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-10b5472d-e6f2-4c3e-900f-898ed63188d5 req-6bd2c8e6-9751-4f07-a9f7-985aa4d806f4 service nova] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:20 user nova-compute[75100]: DEBUG nova.compute.manager [req-10b5472d-e6f2-4c3e-900f-898ed63188d5 req-6bd2c8e6-9751-4f07-a9f7-985aa4d806f4 service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] No waiting events found dispatching network-vif-plugged-e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:52:20 user nova-compute[75100]: WARNING nova.compute.manager [req-10b5472d-e6f2-4c3e-900f-898ed63188d5 req-6bd2c8e6-9751-4f07-a9f7-985aa4d806f4 service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Received unexpected event network-vif-plugged-e8662811-27db-4fec-b337-e96139359589 for instance with vm_state building and task_state spawning.
Nov 13 17:52:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:22 user nova-compute[75100]: INFO nova.compute.manager [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Terminating instance
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-75515508-5c14-452b-8fea-afcac6462f6b req-0d631056-a4db-432b-b0f4-0b8b838079f2 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-vif-unplugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-75515508-5c14-452b-8fea-afcac6462f6b req-0d631056-a4db-432b-b0f4-0b8b838079f2 service nova] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-75515508-5c14-452b-8fea-afcac6462f6b req-0d631056-a4db-432b-b0f4-0b8b838079f2 service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-75515508-5c14-452b-8fea-afcac6462f6b req-0d631056-a4db-432b-b0f4-0b8b838079f2 service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-75515508-5c14-452b-8fea-afcac6462f6b req-0d631056-a4db-432b-b0f4-0b8b838079f2 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] No waiting events found dispatching network-vif-unplugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-75515508-5c14-452b-8fea-afcac6462f6b req-0d631056-a4db-432b-b0f4-0b8b838079f2 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-vif-unplugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Instance destroyed successfully.
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lazy-loading 'resources' on Instance uuid 88ac770d-eefa-4c0c-86e7-2d50fd322d28 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:46:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2137819338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2137819338',id=46,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvKi8s04o0q2ooK0TBJF2ZO2Wdyk2/m96B9PWdof7c/QR3DTCOboEB2/R6UqnM9GkXYVSP1gUco+D6Np22hZLqeqchxniMB8AiYZoKAUvW73f6HYLMUUI3puDPFNU1uOw==',key_name='tempest-keypair-143936512',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:50:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db67a12bfc7f48b380175a6871012f25',ramdisk_id='',reservation_id='r-n3ft0jyg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1414200693',owner_user_name='tempest-AttachVolumeShelveTestJSON-1414200693-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:50:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54440f660c64141ad91285ddef65ca9',uuid=88ac770d-eefa-4c0c-86e7-2d50fd322d28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converting VIF {"id": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "address": "fa:16:3e:b5:32:a1", "network": {"id": "27b045e8-b7bd-44d3-a38c-63f86d94b629", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-229239302-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db67a12bfc7f48b380175a6871012f25", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd535aaf8-4b", "ovs_interfaceid": "d535aaf8-4bce-4fdb-924b-a4fbb91d204b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG os_vif [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd535aaf8-4b, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fddb49b1-b6e0-431c-aa08-318864442f8f) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:52:22 user nova-compute[75100]: INFO os_vif [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:32:a1,bridge_name='br-int',has_traffic_filtering=True,id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b,network=Network(27b045e8-b7bd-44d3-a38c-63f86d94b629),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd535aaf8-4b')
Nov 13 17:52:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Deleting instance files /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28_del
Nov 13 17:52:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Deletion of /opt/stack/data/nova/instances/88ac770d-eefa-4c0c-86e7-2d50fd322d28_del complete
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:52:22 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Instance spawned successfully.
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:52:22 user nova-compute[75100]: INFO nova.compute.manager [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 17:52:22 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:52:22 user nova-compute[75100]: INFO nova.compute.manager [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Took 5.31 seconds to spawn the instance on the hypervisor.
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.compute.manager [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3ed9604-11a7-4780-90d5-ab7c081dddd7 req-687510db-b0c4-4864-886b-5db89206360d service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Received event network-vif-plugged-e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3ed9604-11a7-4780-90d5-ab7c081dddd7 req-687510db-b0c4-4864-886b-5db89206360d service nova] Acquiring lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3ed9604-11a7-4780-90d5-ab7c081dddd7 req-687510db-b0c4-4864-886b-5db89206360d service nova] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f3ed9604-11a7-4780-90d5-ab7c081dddd7 req-687510db-b0c4-4864-886b-5db89206360d service nova] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:22 user nova-compute[75100]: DEBUG nova.compute.manager [req-f3ed9604-11a7-4780-90d5-ab7c081dddd7 req-687510db-b0c4-4864-886b-5db89206360d service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] No waiting events found dispatching network-vif-plugged-e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:52:22 user nova-compute[75100]: WARNING nova.compute.manager [req-f3ed9604-11a7-4780-90d5-ab7c081dddd7 req-687510db-b0c4-4864-886b-5db89206360d service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Received unexpected event network-vif-plugged-e8662811-27db-4fec-b337-e96139359589 for instance with vm_state building and task_state spawning.
Nov 13 17:52:23 user nova-compute[75100]: INFO nova.compute.manager [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Took 5.87 seconds to build instance.
Nov 13 17:52:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f923b81c-5336-4e3f-9093-8bea74c9f6fd tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.967s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:23 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:52:23 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Took 0.64 seconds to deallocate network for instance.
Nov 13 17:52:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-ddc92499-4fb1-4627-9870-5133d7b58bab req-17a15ed2-135a-4bb6-afa9-9c92b1778629 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-vif-deleted-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:52:23 user nova-compute[75100]: INFO nova.compute.manager [req-ddc92499-4fb1-4627-9870-5133d7b58bab req-17a15ed2-135a-4bb6-afa9-9c92b1778629 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Neutron deleted interface d535aaf8-4bce-4fdb-924b-a4fbb91d204b; detaching it from the instance and deleting it from the info cache
Nov 13 17:52:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-ddc92499-4fb1-4627-9870-5133d7b58bab req-17a15ed2-135a-4bb6-afa9-9c92b1778629 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:52:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-ddc92499-4fb1-4627-9870-5133d7b58bab req-17a15ed2-135a-4bb6-afa9-9c92b1778629 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Detach interface failed, port_id=d535aaf8-4bce-4fdb-924b-a4fbb91d204b, reason: Instance 88ac770d-eefa-4c0c-86e7-2d50fd322d28 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:52:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:23 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:52:23 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:52:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:23 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Deleted allocations for instance 88ac770d-eefa-4c0c-86e7-2d50fd322d28
Nov 13 17:52:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-c81c1058-dd74-4e07-bc82-c8692dd3d3e8 tempest-AttachVolumeShelveTestJSON-1414200693 tempest-AttachVolumeShelveTestJSON-1414200693-project-member] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.923s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-603f1b49-56bd-450a-9bb9-5c021a1cf922 req-27ab8300-58d6-473d-8545-099a3e58ad17 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received event network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:52:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-603f1b49-56bd-450a-9bb9-5c021a1cf922 req-27ab8300-58d6-473d-8545-099a3e58ad17 service nova] Acquiring lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-603f1b49-56bd-450a-9bb9-5c021a1cf922 req-27ab8300-58d6-473d-8545-099a3e58ad17 service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:24 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-603f1b49-56bd-450a-9bb9-5c021a1cf922 req-27ab8300-58d6-473d-8545-099a3e58ad17 service nova] Lock "88ac770d-eefa-4c0c-86e7-2d50fd322d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:24 user nova-compute[75100]: DEBUG nova.compute.manager [req-603f1b49-56bd-450a-9bb9-5c021a1cf922 req-27ab8300-58d6-473d-8545-099a3e58ad17 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] No waiting events found dispatching network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:52:24 user nova-compute[75100]: WARNING nova.compute.manager [req-603f1b49-56bd-450a-9bb9-5c021a1cf922 req-27ab8300-58d6-473d-8545-099a3e58ad17 service nova] [instance: 88ac770d-eefa-4c0c-86e7-2d50fd322d28] Received unexpected event network-vif-plugged-d535aaf8-4bce-4fdb-924b-a4fbb91d204b for instance with vm_state deleted and task_state None.
Nov 13 17:52:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:52:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:41 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:52:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:52:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:52:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:52:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 17:52:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:52:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:52:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:52:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:52:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8737MB free_disk=25.02448272705078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance b26889eb-fbdf-4493-aa96-88ee75b33a00 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 1cfeb033-e57f-43b5-9dd5-5bdee2a68237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:52:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:52:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:52:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:52:52 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:52:52 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:52:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-98fd231d-7269-4e04-98be-2a44dd3b9dbc req-27bb739c-b0db-4279-986c-9b7d46592a78 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Received event network-changed-10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:52:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-98fd231d-7269-4e04-98be-2a44dd3b9dbc req-27bb739c-b0db-4279-986c-9b7d46592a78 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Refreshing instance network info cache due to event network-changed-10842f42-2861-476a-a5d9-31ad3412b516. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:52:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-98fd231d-7269-4e04-98be-2a44dd3b9dbc req-27bb739c-b0db-4279-986c-9b7d46592a78 service nova] Acquiring lock "refresh_cache-b26889eb-fbdf-4493-aa96-88ee75b33a00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:52:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-98fd231d-7269-4e04-98be-2a44dd3b9dbc req-27bb739c-b0db-4279-986c-9b7d46592a78 service nova] Acquired lock "refresh_cache-b26889eb-fbdf-4493-aa96-88ee75b33a00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:52:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-98fd231d-7269-4e04-98be-2a44dd3b9dbc req-27bb739c-b0db-4279-986c-9b7d46592a78 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Refreshing network info cache for port 10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:52:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-98fd231d-7269-4e04-98be-2a44dd3b9dbc req-27bb739c-b0db-4279-986c-9b7d46592a78 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Updated VIF entry in instance network info cache for port 10842f42-2861-476a-a5d9-31ad3412b516. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:52:54 user nova-compute[75100]: DEBUG nova.network.neutron [req-98fd231d-7269-4e04-98be-2a44dd3b9dbc req-27bb739c-b0db-4279-986c-9b7d46592a78 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Updating instance_info_cache with network_info: [{"id": "10842f42-2861-476a-a5d9-31ad3412b516", "address": "fa:16:3e:b6:4a:c8", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10842f42-28", "ovs_interfaceid": "10842f42-2861-476a-a5d9-31ad3412b516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:52:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-98fd231d-7269-4e04-98be-2a44dd3b9dbc req-27bb739c-b0db-4279-986c-9b7d46592a78 service nova] Releasing lock "refresh_cache-b26889eb-fbdf-4493-aa96-88ee75b33a00" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:52:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lazy-loading 'flavor' on Instance uuid b26889eb-fbdf-4493-aa96-88ee75b33a00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:52:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Ignoring supplied device name: /dev/vdb
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:52:55 user nova-compute[75100]: INFO nova.compute.manager [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Attaching volume 2eb35df3-e7ec-4f0a-b204-4e3170f48940 to /dev/vdb
Nov 13 17:52:55 user nova-compute[75100]: DEBUG os_brick.utils [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe877845-3dd8-40a1-9050-9d2f5e5dc2c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd372a4-e463-4258-b818-fc111954f0c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81fc698-905b-431e-a83f-d08bfb6c2bec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[43759674-36f5-44c2-8f97-ae4bd5e7f349]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:52:55 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:52:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03ee1ee-404b-49b1-9212-b57881bb3cfa]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG os_brick.utils [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:52:55 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Updating existing volume attachment record: 924c36aa-ae9d-45d2-b5eb-e3eb79a24567 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:52:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJLagGKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:52:59 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:52:59 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:52:59 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee3ae7e-b486-45b8-baed-415230720469]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:52:59 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ad8fbc-9541-4a8c-86d0-d33e83fa0bcb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940] added
Nov 13 17:52:59 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d900ade0-1fb4-4146-b870-7312c34fb5e9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcb2480-26d2-493b-9e50-42ca9fd2870f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJLagGKI {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FJLagGKI" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed80d01-150a-491b-ab77-97fc815619a6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FJLagGKI'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6752fe15-9f9e-4d5f-bc5a-79e54e29bd47]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9e64e-375d-422d-a8e9-29297c25af36]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:52:59 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:52:59 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:52:59 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 17:52:59 user nova-compute[75100]: 
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4dd651-b617-47c5-88e6-283997d48f4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940, portal: 172.16.0.220,3260]
Nov 13 17:52:59 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940, portal: 172.16.0.220,3260] successful.
Nov 13 17:52:59 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d460556-8eae-4dd6-84c3-4551a1f165d5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaaae97a-cf85-4684-89fd-e6d6b9c5af73]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 (non-flash)
Nov 13 17:52:59 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 (non-flash)
Nov 13 17:52:59 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed1cc8b-ae69-4a58-b90a-03c8cab996ab]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:52:59 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJLagGKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:53:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:53:00 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26134376235393862', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:53:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134376235393862', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:53:00 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lazy-loading 'flavor' on Instance uuid b26889eb-fbdf-4493-aa96-88ee75b33a00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:53:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:53:00 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:53:00 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:53:00 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:53:00 user nova-compute[75100]:   <serial>2eb35df3-e7ec-4f0a-b204-4e3170f48940</serial>
Nov 13 17:53:00 user nova-compute[75100]: </disk>
Nov 13 17:53:00 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:53:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:53:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:53:00 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] No VIF found with MAC fa:16:3e:b6:4a:c8, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:53:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d2751603-1388-4b3a-9fa6-b1ee65ce4e9b tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.904s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:53:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:53:07 user nova-compute[75100]: INFO nova.compute.manager [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Detaching volume 2eb35df3-e7ec-4f0a-b204-4e3170f48940
Nov 13 17:53:07 user nova-compute[75100]: INFO nova.virt.block_device [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Attempting to driver detach volume 2eb35df3-e7ec-4f0a-b204-4e3170f48940 from mountpoint /dev/vdb
Nov 13 17:53:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Attempting to detach device vdb from instance b26889eb-fbdf-4493-aa96-88ee75b33a00 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:53:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:53:07 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:53:07 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:53:07 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:53:07 user nova-compute[75100]:   <serial>2eb35df3-e7ec-4f0a-b204-4e3170f48940</serial>
Nov 13 17:53:07 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:53:07 user nova-compute[75100]: </disk>
Nov 13 17:53:07 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:53:07 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Successfully detached device vdb from instance b26889eb-fbdf-4493-aa96-88ee75b33a00 from the persistent domain config.
Nov 13 17:53:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b26889eb-fbdf-4493-aa96-88ee75b33a00 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:53:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:53:07 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:53:07 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 17:53:07 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:53:07 user nova-compute[75100]:   <serial>2eb35df3-e7ec-4f0a-b204-4e3170f48940</serial>
Nov 13 17:53:07 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:53:07 user nova-compute[75100]: </disk>
Nov 13 17:53:07 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:53:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:53:08 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b26889eb-fbdf-4493-aa96-88ee75b33a00 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:53:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:53:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:53:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:53:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:53:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:28 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b26889eb-fbdf-4493-aa96-88ee75b33a00 is timed out.
Nov 13 17:53:28 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Successfully detached device vdb from instance b26889eb-fbdf-4493-aa96-88ee75b33a00 from the live domain config.
Nov 13 17:53:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJLagGKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:53:28 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d0b424-8267-4bc3-9741-8ddab6d16eca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:53:28 user nova-compute[75100]: No targets found.
Nov 13 17:53:28 user nova-compute[75100]: iSNS:
Nov 13 17:53:28 user nova-compute[75100]: No targets found.
Nov 13 17:53:28 user nova-compute[75100]: STATIC:
Nov 13 17:53:28 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940
Nov 13 17:53:28 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:53:28 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:53:28 user nova-compute[75100]: FIRMWARE:
Nov 13 17:53:28 user nova-compute[75100]: No targets found.
Nov 13 17:53:28 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:53:28 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:53:28 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1f5d7c-45a0-4a51-b9fc-a8d1a0737aab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f25143-ff61-4d11-a2f5-f7fc30d880c1]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 (non-flash)
Nov 13 17:53:28 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 (non-flash)
Nov 13 17:53:28 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38bb51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0991717b-9904-4e61-89e2-acbac763e8be]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[befa1a58-5872-4a07-80eb-8314749eb336]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7059d38-4c47-458d-9467-95b522e4e39c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa1d73b-0b46-4a04-8868-461cf7be50a4]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a752fc-6ff3-49cf-9a53-23e811116545]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[42843784-4da2-465e-9645-0c454c793f22]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940, portal: 172.16.0.220,3260]
Nov 13 17:53:28 user nova-compute[75100]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940, portal: 172.16.0.220,3260] successful.
Nov 13 17:53:28 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[773744e1-9036-4d4f-bc7c-6fcc59a3c295]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] <== disconnect_volume: return (291ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:53:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG nova.objects.instance [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lazy-loading 'flavor' on Instance uuid b26889eb-fbdf-4493-aa96-88ee75b33a00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-63420b45-01b4-4124-a00a-fc3cae44f7a9 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.601s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.457s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:53:29 user nova-compute[75100]: INFO nova.compute.manager [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Terminating instance
Nov 13 17:53:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-70fb8bec-c5b9-4cee-ab95-4d25ca32f0d5 req-4ed2b163-26ca-42ef-8ffd-4b33575d4e19 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Received event network-vif-unplugged-10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-70fb8bec-c5b9-4cee-ab95-4d25ca32f0d5 req-4ed2b163-26ca-42ef-8ffd-4b33575d4e19 service nova] Acquiring lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-70fb8bec-c5b9-4cee-ab95-4d25ca32f0d5 req-4ed2b163-26ca-42ef-8ffd-4b33575d4e19 service nova] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-70fb8bec-c5b9-4cee-ab95-4d25ca32f0d5 req-4ed2b163-26ca-42ef-8ffd-4b33575d4e19 service nova] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-70fb8bec-c5b9-4cee-ab95-4d25ca32f0d5 req-4ed2b163-26ca-42ef-8ffd-4b33575d4e19 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] No waiting events found dispatching network-vif-unplugged-10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:53:29 user nova-compute[75100]: DEBUG nova.compute.manager [req-70fb8bec-c5b9-4cee-ab95-4d25ca32f0d5 req-4ed2b163-26ca-42ef-8ffd-4b33575d4e19 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Received event network-vif-unplugged-10842f42-2861-476a-a5d9-31ad3412b516 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:53:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Instance destroyed successfully.
Nov 13 17:53:30 user nova-compute[75100]: DEBUG nova.objects.instance [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lazy-loading 'resources' on Instance uuid b26889eb-fbdf-4493-aa96-88ee75b33a00 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:51:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1877836019',display_name='tempest-VolumesSnapshotTestJSON-instance-1877836019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1877836019',id=49,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDmMYsTfVqvjBp8WSFM/vRY6DgmQroa3xOaIGfBPq3IF0+xD/mXhwn/FT9yjBieMoFtPcRzRd7LFT5CVu/mZClZfFWD7CvYx7Fpr/0g9PN4uGq2bIUiLpAI5D4LC2XTW7g==',key_name='tempest-keypair-1644379708',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:51:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='17d095299b54496bae4390b9b462a8d9',ramdisk_id='',reservation_id='r-rj2i4ahc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1809692111',owner_user_name='tempest-VolumesSnapshotTestJSON-1809692111-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:51:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='059e22ba39774ecc93789262a27570a4',uuid=b26889eb-fbdf-4493-aa96-88ee75b33a00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10842f42-2861-476a-a5d9-31ad3412b516", "address": "fa:16:3e:b6:4a:c8", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10842f42-28", "ovs_interfaceid": "10842f42-2861-476a-a5d9-31ad3412b516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Converting VIF {"id": "10842f42-2861-476a-a5d9-31ad3412b516", "address": "fa:16:3e:b6:4a:c8", "network": {"id": "8e136812-43b2-4b5e-b902-81843992524b", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1865074611-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "17d095299b54496bae4390b9b462a8d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10842f42-28", "ovs_interfaceid": "10842f42-2861-476a-a5d9-31ad3412b516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=10842f42-2861-476a-a5d9-31ad3412b516,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10842f42-28') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG os_vif [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=10842f42-2861-476a-a5d9-31ad3412b516,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10842f42-28') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10842f42-28, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10ccdf84-5a34-4265-9d7e-d5582c915704) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:53:30 user nova-compute[75100]: INFO os_vif [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:4a:c8,bridge_name='br-int',has_traffic_filtering=True,id=10842f42-2861-476a-a5d9-31ad3412b516,network=Network(8e136812-43b2-4b5e-b902-81843992524b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10842f42-28')
Nov 13 17:53:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:2eb35df3-e7ec-4f0a-b204-4e3170f48940', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FJLagGKI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:53:30 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:53:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[8dc80700-6ff8-431e-9d8c-2694c45136ce]: Unexpected error while running command.
Nov 13 17:53:30 user nova-compute[75100]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 17:53:30 user nova-compute[75100]: Exit code: 21
Nov 13 17:53:30 user nova-compute[75100]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 17:53:30 user nova-compute[75100]: Stderr: '' {{(pid=85770) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 13 17:53:30 user nova-compute[75100]: Traceback (most recent call last):
Nov 13 17:53:30 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 13 17:53:30 user nova-compute[75100]:     ret = func(*f_args, **f_kwargs)
Nov 13 17:53:30 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 13 17:53:30 user nova-compute[75100]:     return func(*args, **kwargs)
Nov 13 17:53:30 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 13 17:53:30 user nova-compute[75100]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 13 17:53:30 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 13 17:53:30 user nova-compute[75100]:     return putils.execute(on_execute=on_execute,
Nov 13 17:53:30 user nova-compute[75100]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 13 17:53:30 user nova-compute[75100]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 13 17:53:30 user nova-compute[75100]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 13 17:53:30 user nova-compute[75100]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 17:53:30 user nova-compute[75100]: Exit code: 21
Nov 13 17:53:30 user nova-compute[75100]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 17:53:30 user nova-compute[75100]: Stderr: ''
Nov 13 17:53:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc80700-6ff8-431e-9d8c-2694c45136ce]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 13 17:53:30 user nova-compute[75100]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 17:53:30 user nova-compute[75100]: Exit code: 21
Nov 13 17:53:30 user nova-compute[75100]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 17:53:30 user nova-compute[75100]: Stderr: ''
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 13 17:53:30 user nova-compute[75100]: ERROR os_brick.initiator.connectors.iscsi 
Nov 13 17:53:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=75100) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.025s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] <== disconnect_volume: return (27ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:53:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Deleting instance files /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00_del
Nov 13 17:53:30 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Deletion of /opt/stack/data/nova/instances/b26889eb-fbdf-4493-aa96-88ee75b33a00_del complete
Nov 13 17:53:30 user nova-compute[75100]: INFO nova.compute.manager [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 13 17:53:30 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:53:30 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:53:31 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:53:31 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Took 0.89 seconds to deallocate network for instance.
Nov 13 17:53:31 user nova-compute[75100]: WARNING nova.volume.cinder [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Attachment 924c36aa-ae9d-45d2-b5eb-e3eb79a24567 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 924c36aa-ae9d-45d2-b5eb-e3eb79a24567. (HTTP 404) (Request-ID: req-f816172e-7d83-46ff-9330-6f0599e9d299)
Nov 13 17:53:31 user nova-compute[75100]: INFO nova.compute.manager [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Took 0.03 seconds to detach 1 volumes for instance.
Nov 13 17:53:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-fa96639c-86f2-4ab2-97ce-9e0c411d98be req-b6f0461a-310e-4a38-b6f9-0721b2dad26a service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Received event network-vif-deleted-10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:53:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:53:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:53:31 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:53:31 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:53:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:53:31 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Deleted allocations for instance b26889eb-fbdf-4493-aa96-88ee75b33a00
Nov 13 17:53:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-88183e7d-4ef6-4055-a58c-518e5383ef69 tempest-VolumesSnapshotTestJSON-1809692111 tempest-VolumesSnapshotTestJSON-1809692111-project-member] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.198s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:53:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-bb6a8597-3492-4d3e-8970-df4e47080ae9 req-abe27130-177e-4d9f-b1c5-d5db52ae6820 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Received event network-vif-plugged-10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:53:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bb6a8597-3492-4d3e-8970-df4e47080ae9 req-abe27130-177e-4d9f-b1c5-d5db52ae6820 service nova] Acquiring lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:53:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bb6a8597-3492-4d3e-8970-df4e47080ae9 req-abe27130-177e-4d9f-b1c5-d5db52ae6820 service nova] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:53:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bb6a8597-3492-4d3e-8970-df4e47080ae9 req-abe27130-177e-4d9f-b1c5-d5db52ae6820 service nova] Lock "b26889eb-fbdf-4493-aa96-88ee75b33a00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:53:31 user nova-compute[75100]: DEBUG nova.compute.manager [req-bb6a8597-3492-4d3e-8970-df4e47080ae9 req-abe27130-177e-4d9f-b1c5-d5db52ae6820 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] No waiting events found dispatching network-vif-plugged-10842f42-2861-476a-a5d9-31ad3412b516 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:53:31 user nova-compute[75100]: WARNING nova.compute.manager [req-bb6a8597-3492-4d3e-8970-df4e47080ae9 req-abe27130-177e-4d9f-b1c5-d5db52ae6820 service nova] [instance: b26889eb-fbdf-4493-aa96-88ee75b33a00] Received unexpected event network-vif-plugged-10842f42-2861-476a-a5d9-31ad3412b516 for instance with vm_state deleted and task_state None.
Nov 13 17:53:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:53:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:53:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:53:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:53:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:42 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:53:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:53:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:53:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:53:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-1cfeb033-e57f-43b5-9dd5-5bdee2a68237" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:53:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-1cfeb033-e57f-43b5-9dd5-5bdee2a68237" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:53:44 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:53:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 1cfeb033-e57f-43b5-9dd5-5bdee2a68237 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:53:44 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Updating instance_info_cache with network_info: [{"id": "e8662811-27db-4fec-b337-e96139359589", "address": "fa:16:3e:95:13:63", "network": {"id": "2e43774a-c50f-4f1b-8904-214b6fac4949", "bridge": "br-int", "label": "tempest-VolumesActionsTest-497962766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e890babfa1473fb7e7e0acccf8fb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8662811-27", "ovs_interfaceid": "e8662811-27db-4fec-b337-e96139359589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:53:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-1cfeb033-e57f-43b5-9dd5-5bdee2a68237" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:53:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:53:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:53:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:53:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:53:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:53:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:53:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:53:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:53:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:53:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:53:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:53:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8885MB free_disk=25.048080444335938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:53:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 1cfeb033-e57f-43b5-9dd5-5bdee2a68237 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:53:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:53:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:53:46 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:53:46 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:53:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:53:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:53:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:53:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:53:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:53:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:53:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:53:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:53:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:53:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:54:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:54:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:54:09 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:54:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:54:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Acquiring lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Acquiring lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:10 user nova-compute[75100]: INFO nova.compute.manager [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Terminating instance
Nov 13 17:54:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-64546c1a-8eeb-4218-9c89-bc5f31ab61bb req-29739074-e463-4b11-bebb-41ec250861d9 service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Received event network-vif-unplugged-e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64546c1a-8eeb-4218-9c89-bc5f31ab61bb req-29739074-e463-4b11-bebb-41ec250861d9 service nova] Acquiring lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64546c1a-8eeb-4218-9c89-bc5f31ab61bb req-29739074-e463-4b11-bebb-41ec250861d9 service nova] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-64546c1a-8eeb-4218-9c89-bc5f31ab61bb req-29739074-e463-4b11-bebb-41ec250861d9 service nova] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-64546c1a-8eeb-4218-9c89-bc5f31ab61bb req-29739074-e463-4b11-bebb-41ec250861d9 service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] No waiting events found dispatching network-vif-unplugged-e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG nova.compute.manager [req-64546c1a-8eeb-4218-9c89-bc5f31ab61bb req-29739074-e463-4b11-bebb-41ec250861d9 service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Received event network-vif-unplugged-e8662811-27db-4fec-b337-e96139359589 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:54:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Instance destroyed successfully.
Nov 13 17:54:11 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lazy-loading 'resources' on Instance uuid 1cfeb033-e57f-43b5-9dd5-5bdee2a68237 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:52:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1472888854',display_name='tempest-VolumesActionsTest-instance-1472888854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1472888854',id=50,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:52:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3e890babfa1473fb7e7e0acccf8fb4e',ramdisk_id='',reservation_id='r-z3ll3txv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-852444592',owner_user_name='tempest-VolumesActionsTest-852444592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:52:23Z,user_data=None,user_id='f824892c732e48e3a26b2e4a0fd0307e',uuid=1cfeb033-e57f-43b5-9dd5-5bdee2a68237,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8662811-27db-4fec-b337-e96139359589", "address": "fa:16:3e:95:13:63", "network": {"id": "2e43774a-c50f-4f1b-8904-214b6fac4949", "bridge": "br-int", "label": "tempest-VolumesActionsTest-497962766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e890babfa1473fb7e7e0acccf8fb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8662811-27", "ovs_interfaceid": "e8662811-27db-4fec-b337-e96139359589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Converting VIF {"id": "e8662811-27db-4fec-b337-e96139359589", "address": "fa:16:3e:95:13:63", "network": {"id": "2e43774a-c50f-4f1b-8904-214b6fac4949", "bridge": "br-int", "label": "tempest-VolumesActionsTest-497962766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3e890babfa1473fb7e7e0acccf8fb4e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8662811-27", "ovs_interfaceid": "e8662811-27db-4fec-b337-e96139359589", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:13:63,bridge_name='br-int',has_traffic_filtering=True,id=e8662811-27db-4fec-b337-e96139359589,network=Network(2e43774a-c50f-4f1b-8904-214b6fac4949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8662811-27') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG os_vif [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:13:63,bridge_name='br-int',has_traffic_filtering=True,id=e8662811-27db-4fec-b337-e96139359589,network=Network(2e43774a-c50f-4f1b-8904-214b6fac4949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8662811-27') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8662811-27, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=568e6300-db9e-4670-a1e8-5a799effd147) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:54:11 user nova-compute[75100]: INFO os_vif [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:13:63,bridge_name='br-int',has_traffic_filtering=True,id=e8662811-27db-4fec-b337-e96139359589,network=Network(2e43774a-c50f-4f1b-8904-214b6fac4949),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8662811-27')
Nov 13 17:54:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Deleting instance files /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237_del
Nov 13 17:54:11 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Deletion of /opt/stack/data/nova/instances/1cfeb033-e57f-43b5-9dd5-5bdee2a68237_del complete
Nov 13 17:54:11 user nova-compute[75100]: INFO nova.compute.manager [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 17:54:11 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:54:11 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:54:12 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:54:12 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Took 0.45 seconds to deallocate network for instance.
Nov 13 17:54:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a74e656-6e5b-4bc3-8014-5f0a5369dcd3 req-2505c4e0-f84e-412d-a69d-1ba05bbe0c03 service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Received event network-vif-deleted-e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:54:12 user nova-compute[75100]: INFO nova.compute.manager [req-2a74e656-6e5b-4bc3-8014-5f0a5369dcd3 req-2505c4e0-f84e-412d-a69d-1ba05bbe0c03 service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Neutron deleted interface e8662811-27db-4fec-b337-e96139359589; detaching it from the instance and deleting it from the info cache
Nov 13 17:54:12 user nova-compute[75100]: DEBUG nova.network.neutron [req-2a74e656-6e5b-4bc3-8014-5f0a5369dcd3 req-2505c4e0-f84e-412d-a69d-1ba05bbe0c03 service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:54:12 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a74e656-6e5b-4bc3-8014-5f0a5369dcd3 req-2505c4e0-f84e-412d-a69d-1ba05bbe0c03 service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Detach interface failed, port_id=e8662811-27db-4fec-b337-e96139359589, reason: Instance 1cfeb033-e57f-43b5-9dd5-5bdee2a68237 could not be found. {{(pid=75100) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:12 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:54:12 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:12 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Deleted allocations for instance 1cfeb033-e57f-43b5-9dd5-5bdee2a68237
Nov 13 17:54:12 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec16fddf-5695-4d52-93d5-951381707c23 tempest-VolumesActionsTest-852444592 tempest-VolumesActionsTest-852444592-project-member] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.645s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-79e644a2-d9ab-4174-9953-99770edab972 req-f782d409-ee42-4afa-8d08-ca13392d3baa service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Received event network-vif-plugged-e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:54:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-79e644a2-d9ab-4174-9953-99770edab972 req-f782d409-ee42-4afa-8d08-ca13392d3baa service nova] Acquiring lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-79e644a2-d9ab-4174-9953-99770edab972 req-f782d409-ee42-4afa-8d08-ca13392d3baa service nova] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:13 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-79e644a2-d9ab-4174-9953-99770edab972 req-f782d409-ee42-4afa-8d08-ca13392d3baa service nova] Lock "1cfeb033-e57f-43b5-9dd5-5bdee2a68237-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:13 user nova-compute[75100]: DEBUG nova.compute.manager [req-79e644a2-d9ab-4174-9953-99770edab972 req-f782d409-ee42-4afa-8d08-ca13392d3baa service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] No waiting events found dispatching network-vif-plugged-e8662811-27db-4fec-b337-e96139359589 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:54:13 user nova-compute[75100]: WARNING nova.compute.manager [req-79e644a2-d9ab-4174-9953-99770edab972 req-f782d409-ee42-4afa-8d08-ca13392d3baa service nova] [instance: 1cfeb033-e57f-43b5-9dd5-5bdee2a68237] Received unexpected event network-vif-plugged-e8662811-27db-4fec-b337-e96139359589 for instance with vm_state deleted and task_state None.
Nov 13 17:54:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:54:32 user nova-compute[75100]: INFO nova.compute.claims [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Claim successful on node user
Nov 13 17:54:32 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:54:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:54:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG nova.policy [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fdcb492bec34312b18321d97ef89d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef1b4c8ac314b159703a41a5ada29be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:54:32 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Creating image(s)
Nov 13 17:54:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "/opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "/opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk 1073741824" returned: 0 in 0.059s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Successfully created port: 4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.196s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Cannot resize image /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Ensure instance console log exists: /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Successfully updated port: 4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquired lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-bcd22b7b-f318-4fd4-83a4-625e86947844 req-8b530df4-8e81-482c-9b4e-e6e5d9e3a769 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Received event network-changed-4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.compute.manager [req-bcd22b7b-f318-4fd4-83a4-625e86947844 req-8b530df4-8e81-482c-9b4e-e6e5d9e3a769 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Refreshing instance network info cache due to event network-changed-4535b571-1e31-4e30-8233-6d78e7f7a8b9. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bcd22b7b-f318-4fd4-83a4-625e86947844 req-8b530df4-8e81-482c-9b4e-e6e5d9e3a769 service nova] Acquiring lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.network.neutron [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updating instance_info_cache with network_info: [{"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Releasing lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Instance network_info: |[{"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bcd22b7b-f318-4fd4-83a4-625e86947844 req-8b530df4-8e81-482c-9b4e-e6e5d9e3a769 service nova] Acquired lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-bcd22b7b-f318-4fd4-83a4-625e86947844 req-8b530df4-8e81-482c-9b4e-e6e5d9e3a769 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Refreshing network info cache for port 4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Start _get_guest_xml network_info=[{"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:54:34 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:54:34 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1084218230',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1084218230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1084218',id=51,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9rG2MqgVO6LUgtT6mvCU8/ZwPZWGIpwtkVjGECN+tXVXKvlubn5ui6hkm0OrIfPtuejrFm5CkoPkTGC+lrWlOhzm9z4dz7TFGpUNZsXhUFMnAqayLd4UyLxmsk2UOXKA==',key_name='tempest-keypair-2088622896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fef1b4c8ac314b159703a41a5ada29be',ramdisk_id='',reservation_id='r-6eb42l3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-900640539',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:54:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fdcb492bec34312b18321d97ef89d9e',uuid=9ec6fa62-91bd-4785-bb4c-7d495f1cf701,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Converting VIF {"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:da:72,bridge_name='br-int',has_traffic_filtering=True,id=4535b571-1e31-4e30-8233-6d78e7f7a8b9,network=Network(650797c3-2232-4770-bca8-b570651d4e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4535b571-1e') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:54:34 user nova-compute[75100]:   <uuid>9ec6fa62-91bd-4785-bb4c-7d495f1cf701</uuid>
Nov 13 17:54:34 user nova-compute[75100]:   <name>instance-00000033</name>
Nov 13 17:54:34 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:54:34 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:54:34 user nova-compute[75100]:   <metadata>
Nov 13 17:54:34 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:54:34 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:54:34 user nova-compute[75100]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1084218230</nova:name>
Nov 13 17:54:34 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:54:34</nova:creationTime>
Nov 13 17:54:34 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:54:34 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:54:34 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:54:34 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:54:34 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:54:34 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:54:34 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:54:34 user nova-compute[75100]:       <nova:owner>
Nov 13 17:54:34 user nova-compute[75100]:         <nova:user uuid="6fdcb492bec34312b18321d97ef89d9e">tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member</nova:user>
Nov 13 17:54:34 user nova-compute[75100]:         <nova:project uuid="fef1b4c8ac314b159703a41a5ada29be">tempest-TestServerVolumeAttachScenarioOldVersion-900640539</nova:project>
Nov 13 17:54:34 user nova-compute[75100]:       </nova:owner>
Nov 13 17:54:34 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 17:54:34 user nova-compute[75100]:       <nova:ports>
Nov 13 17:54:34 user nova-compute[75100]:         <nova:port uuid="4535b571-1e31-4e30-8233-6d78e7f7a8b9">
Nov 13 17:54:34 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 17:54:34 user nova-compute[75100]:         </nova:port>
Nov 13 17:54:34 user nova-compute[75100]:       </nova:ports>
Nov 13 17:54:34 user nova-compute[75100]:     </nova:instance>
Nov 13 17:54:34 user nova-compute[75100]:   </metadata>
Nov 13 17:54:34 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:54:34 user nova-compute[75100]:     <system>
Nov 13 17:54:34 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:54:34 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:54:34 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:54:34 user nova-compute[75100]:       <entry name="serial">9ec6fa62-91bd-4785-bb4c-7d495f1cf701</entry>
Nov 13 17:54:34 user nova-compute[75100]:       <entry name="uuid">9ec6fa62-91bd-4785-bb4c-7d495f1cf701</entry>
Nov 13 17:54:34 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:54:34 user nova-compute[75100]:     </system>
Nov 13 17:54:34 user nova-compute[75100]:   </sysinfo>
Nov 13 17:54:34 user nova-compute[75100]:   <os>
Nov 13 17:54:34 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:54:34 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:54:34 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:54:34 user nova-compute[75100]:   </os>
Nov 13 17:54:34 user nova-compute[75100]:   <features>
Nov 13 17:54:34 user nova-compute[75100]:     <acpi/>
Nov 13 17:54:34 user nova-compute[75100]:     <apic/>
Nov 13 17:54:34 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:54:34 user nova-compute[75100]:   </features>
Nov 13 17:54:34 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:54:34 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:54:34 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:54:34 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:54:34 user nova-compute[75100]:   </clock>
Nov 13 17:54:34 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:54:34 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:54:34 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:54:34 user nova-compute[75100]:   </cpu>
Nov 13 17:54:34 user nova-compute[75100]:   <devices>
Nov 13 17:54:34 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 17:54:34 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 17:54:34 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk"/>
Nov 13 17:54:34 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:54:34 user nova-compute[75100]:     </disk>
Nov 13 17:54:34 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:54:34 user nova-compute[75100]:       <mac address="fa:16:3e:31:da:72"/>
Nov 13 17:54:34 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:54:34 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:54:34 user nova-compute[75100]:       <target dev="tap4535b571-1e"/>
Nov 13 17:54:34 user nova-compute[75100]:     </interface>
Nov 13 17:54:34 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:54:34 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/console.log" append="off"/>
Nov 13 17:54:34 user nova-compute[75100]:     </serial>
Nov 13 17:54:34 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:54:34 user nova-compute[75100]:     <video>
Nov 13 17:54:34 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:54:34 user nova-compute[75100]:     </video>
Nov 13 17:54:34 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:54:34 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:54:34 user nova-compute[75100]:     </rng>
Nov 13 17:54:34 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:54:34 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:54:34 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:54:34 user nova-compute[75100]:     </memballoon>
Nov 13 17:54:34 user nova-compute[75100]:   </devices>
Nov 13 17:54:34 user nova-compute[75100]: </domain>
Nov 13 17:54:34 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1084218230',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1084218230',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1084218',id=51,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9rG2MqgVO6LUgtT6mvCU8/ZwPZWGIpwtkVjGECN+tXVXKvlubn5ui6hkm0OrIfPtuejrFm5CkoPkTGC+lrWlOhzm9z4dz7TFGpUNZsXhUFMnAqayLd4UyLxmsk2UOXKA==',key_name='tempest-keypair-2088622896',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fef1b4c8ac314b159703a41a5ada29be',ramdisk_id='',reservation_id='r-6eb42l3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-900640539',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:54:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fdcb492bec34312b18321d97ef89d9e',uuid=9ec6fa62-91bd-4785-bb4c-7d495f1cf701,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Converting VIF {"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:da:72,bridge_name='br-int',has_traffic_filtering=True,id=4535b571-1e31-4e30-8233-6d78e7f7a8b9,network=Network(650797c3-2232-4770-bca8-b570651d4e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4535b571-1e') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG os_vif [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:da:72,bridge_name='br-int',has_traffic_filtering=True,id=4535b571-1e31-4e30-8233-6d78e7f7a8b9,network=Network(650797c3-2232-4770-bca8-b570651d4e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4535b571-1e') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05a474fe-425e-594c-9bab-7df9243c5424', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4535b571-1e, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4535b571-1e, col_values=(('qos', UUID('492bf6f9-282d-42f0-9ad1-60b5d3838ee3')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4535b571-1e, col_values=(('external_ids', {'iface-id': '4535b571-1e31-4e30-8233-6d78e7f7a8b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:da:72', 'vm-uuid': '9ec6fa62-91bd-4785-bb4c-7d495f1cf701'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:34 user nova-compute[75100]: INFO os_vif [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:da:72,bridge_name='br-int',has_traffic_filtering=True,id=4535b571-1e31-4e30-8233-6d78e7f7a8b9,network=Network(650797c3-2232-4770-bca8-b570651d4e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4535b571-1e')
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] No VIF found with MAC fa:16:3e:31:da:72, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-bcd22b7b-f318-4fd4-83a4-625e86947844 req-8b530df4-8e81-482c-9b4e-e6e5d9e3a769 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updated VIF entry in instance network info cache for port 4535b571-1e31-4e30-8233-6d78e7f7a8b9. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG nova.network.neutron [req-bcd22b7b-f318-4fd4-83a4-625e86947844 req-8b530df4-8e81-482c-9b4e-e6e5d9e3a769 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updating instance_info_cache with network_info: [{"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:54:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-bcd22b7b-f318-4fd4-83a4-625e86947844 req-8b530df4-8e81-482c-9b4e-e6e5d9e3a769 service nova] Releasing lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:54:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-de504db6-529b-412c-9511-4c2d63fa04da req-543bbea9-5a2f-416c-94d7-1dce6a9bfba9 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Received event network-vif-plugged-4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:54:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-de504db6-529b-412c-9511-4c2d63fa04da req-543bbea9-5a2f-416c-94d7-1dce6a9bfba9 service nova] Acquiring lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-de504db6-529b-412c-9511-4c2d63fa04da req-543bbea9-5a2f-416c-94d7-1dce6a9bfba9 service nova] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-de504db6-529b-412c-9511-4c2d63fa04da req-543bbea9-5a2f-416c-94d7-1dce6a9bfba9 service nova] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-de504db6-529b-412c-9511-4c2d63fa04da req-543bbea9-5a2f-416c-94d7-1dce6a9bfba9 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] No waiting events found dispatching network-vif-plugged-4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:54:35 user nova-compute[75100]: WARNING nova.compute.manager [req-de504db6-529b-412c-9511-4c2d63fa04da req-543bbea9-5a2f-416c-94d7-1dce6a9bfba9 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Received unexpected event network-vif-plugged-4535b571-1e31-4e30-8233-6d78e7f7a8b9 for instance with vm_state building and task_state spawning.
Nov 13 17:54:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:54:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Instance spawned successfully.
Nov 13 17:54:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:54:37 user nova-compute[75100]: INFO nova.compute.manager [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 13 17:54:37 user nova-compute[75100]: DEBUG nova.compute.manager [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-c15fc523-2414-4578-a7ba-65845c541298 req-edd657bb-69ba-416c-930b-743779396769 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Received event network-vif-plugged-4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c15fc523-2414-4578-a7ba-65845c541298 req-edd657bb-69ba-416c-930b-743779396769 service nova] Acquiring lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c15fc523-2414-4578-a7ba-65845c541298 req-edd657bb-69ba-416c-930b-743779396769 service nova] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c15fc523-2414-4578-a7ba-65845c541298 req-edd657bb-69ba-416c-930b-743779396769 service nova] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:37 user nova-compute[75100]: DEBUG nova.compute.manager [req-c15fc523-2414-4578-a7ba-65845c541298 req-edd657bb-69ba-416c-930b-743779396769 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] No waiting events found dispatching network-vif-plugged-4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:54:37 user nova-compute[75100]: WARNING nova.compute.manager [req-c15fc523-2414-4578-a7ba-65845c541298 req-edd657bb-69ba-416c-930b-743779396769 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Received unexpected event network-vif-plugged-4535b571-1e31-4e30-8233-6d78e7f7a8b9 for instance with vm_state building and task_state spawning.
Nov 13 17:54:38 user nova-compute[75100]: INFO nova.compute.manager [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Took 5.65 seconds to build instance.
Nov 13 17:54:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-5b5a6e0f-457f-4124-a0c2-9a5bc6a8b9c5 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.742s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:43 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:54:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:54:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:54:44 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:54:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:54:44 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:54:44 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:54:44 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updating instance_info_cache with network_info: [{"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:54:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:54:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:54:46 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:54:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=9035MB free_disk=25.062381744384766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:54:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:54:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:54:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:54:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:54:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:54:46 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:54:46 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:54:46 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:54:46 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:54:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:54:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:54:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:54:52 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:54:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:54:56 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:54:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:54:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:54:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Verify base images {{(pid=75100) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Image id 40ac832f-026d-4a87-87c5-ec47fa8f4825 yields fingerprint dcd5dd4da951cedb21ed0abb849f260b915b72f9 {{(pid=75100) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 13 17:55:11 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] image 40ac832f-026d-4a87-87c5-ec47fa8f4825 at (/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9): checking
Nov 13 17:55:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] image 40ac832f-026d-4a87-87c5-ec47fa8f4825 at (/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9): image is in use {{(pid=75100) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75100) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 is a valid instance name {{(pid=75100) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 has a disk file {{(pid=75100) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 is backed by dcd5dd4da951cedb21ed0abb849f260b915b72f9 {{(pid=75100) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 13 17:55:11 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7
Nov 13 17:55:11 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228
Nov 13 17:55:11 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96
Nov 13 17:55:11 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073
Nov 13 17:55:11 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45
Nov 13 17:55:11 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2
Nov 13 17:55:11 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525
Nov 13 17:55:11 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559
Nov 13 17:55:11 user nova-compute[75100]: WARNING nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Unknown base file: /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739
Nov 13 17:55:11 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Active base files: /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9
Nov 13 17:55:11 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Removable base files: /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7 /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228 /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96 /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073 /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45 /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2 /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525 /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559 /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739
Nov 13 17:55:11 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f0c5bec05ac27637e6af8ce61e4927803a3127b7
Nov 13 17:55:11 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/340aa4876384b67f7faafd9a4b1d331e20adf228
Nov 13 17:55:11 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/07f0265ad06627d124df90fce7e2bfbf2d148d96
Nov 13 17:55:11 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e5a596f820172de77e6bbb4fcd0a1e9231b09073
Nov 13 17:55:11 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/27528f37d18282952c633615555d7b359ca82b45
Nov 13 17:55:11 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6db4f5b59dd41c55b58ae75de2b7992b93622bc2
Nov 13 17:55:11 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b728af2a36dfc0004715060419be4d06a853e525
Nov 13 17:55:11 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f38b843469335f4bfb4f737713b1e7c0f1cce559
Nov 13 17:55:11 user nova-compute[75100]: INFO nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/917a56892bf47e22539f4dd61e38f45ce2c86739
Nov 13 17:55:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Verification complete {{(pid=75100) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Verify swap images {{(pid=75100) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 13 17:55:11 user nova-compute[75100]: DEBUG nova.virt.libvirt.imagecache [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Verify ephemeral images {{(pid=75100) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 13 17:55:14 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:19 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:24 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:55:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:55:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:55:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:55:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:55:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:55:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:39 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:55:44 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:55:44 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:55:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:55:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:55:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:55:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:55:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:55:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:55:45 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:55:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updating instance_info_cache with network_info: [{"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:55:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:55:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:55:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:55:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:55:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:55:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:55:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:55:47 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:55:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:55:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:55:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:55:47 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:55:48 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:55:48 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:55:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8948MB free_disk=25.031490325927734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing inventories for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating ProviderTree inventory for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating inventory in ProviderTree for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing aggregate associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing trait associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:55:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:55:49 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:55:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:55:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:55:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:57 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:55:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:55:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:55:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:55:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:55:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 17:55:58 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 17:55:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:55:59 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:56:01 user nova-compute[75100]: INFO nova.compute.claims [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Claim successful on node user
Nov 13 17:56:01 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 17:56:01 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 17:56:01 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG nova.policy [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ba7a5969e5d401ba2963a91ecc29682', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a971df2b049448da3b45ae289e2865c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 17:56:01 user nova-compute[75100]: INFO nova.virt.block_device [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Booting with volume b4106100-9141-4e17-82b8-3445f97da7cd at /dev/vda
Nov 13 17:56:01 user nova-compute[75100]: DEBUG os_brick.utils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c26f6e8-1ec6-46da-ba7f-e1b260988f5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83aabe0-9fb7-4f0e-b6aa-b38abf820fd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d74c8a-bcbe-438f-8599-d39382555e0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c6799d-2d89-4dd5-982d-b6e2738d9df3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:56:01 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:56:01 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e1d56c-3283-4f1d-b671-2cd4d1670bf5]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG os_brick.utils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:56:01 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating existing volume attachment record: 77b9c35b-2d12-415b-9fa5-5956e71f3646 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:56:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Successfully created port: b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 17:56:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Successfully updated port: b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 17:56:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:56:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquired lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:56:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:56:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-708f9aa4-4eb1-4cd7-89b7-f28ecdec0722 req-857c2bd7-ce43-4a6a-80a1-d5d501a0891b service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-changed-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:56:02 user nova-compute[75100]: DEBUG nova.compute.manager [req-708f9aa4-4eb1-4cd7-89b7-f28ecdec0722 req-857c2bd7-ce43-4a6a-80a1-d5d501a0891b service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Refreshing instance network info cache due to event network-changed-b49b04b3-fb0d-4572-a83d-a7a023e0f158. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:56:02 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-708f9aa4-4eb1-4cd7-89b7-f28ecdec0722 req-857c2bd7-ce43-4a6a-80a1-d5d501a0891b service nova] Acquiring lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:56:02 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 17:56:03 user nova-compute[75100]: DEBUG nova.network.neutron [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating instance_info_cache with network_info: [{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Releasing lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:56:03 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Instance network_info: |[{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-708f9aa4-4eb1-4cd7-89b7-f28ecdec0722 req-857c2bd7-ce43-4a6a-80a1-d5d501a0891b service nova] Acquired lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:56:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-708f9aa4-4eb1-4cd7-89b7-f28ecdec0722 req-857c2bd7-ce43-4a6a-80a1-d5d501a0891b service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Refreshing network info cache for port b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:56:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-708f9aa4-4eb1-4cd7-89b7-f28ecdec0722 req-857c2bd7-ce43-4a6a-80a1-d5d501a0891b service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updated VIF entry in instance network info cache for port b49b04b3-fb0d-4572-a83d-a7a023e0f158. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:56:03 user nova-compute[75100]: DEBUG nova.network.neutron [req-708f9aa4-4eb1-4cd7-89b7-f28ecdec0722 req-857c2bd7-ce43-4a6a-80a1-d5d501a0891b service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating instance_info_cache with network_info: [{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:56:03 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-708f9aa4-4eb1-4cd7-89b7-f28ecdec0722 req-857c2bd7-ce43-4a6a-80a1-d5d501a0891b service nova] Releasing lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:56:04 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:56:05 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Creating image(s)
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Ensure instance console log exists: /opt/stack/data/nova/instances/ee62ff36-6731-4a1c-9536-00b8e55a63e8/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Start _get_guest_xml network_info=[{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '77b9c35b-2d12-415b-9fa5-5956e71f3646', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIkWgSlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee62ff36-6731-4a1c-9536-00b8e55a63e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4106100-9141-4e17-82b8-3445f97da7cd', 'serial': 'b4106100-9141-4e17-82b8-3445f97da7cd'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:56:05 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:56:05 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:56:05 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIkWgSlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:56:06 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:56:06 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:56:06 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6078daee-ee65-4bd1-87f6-996b51317295]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:56:06 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b2f86d-c488-4f8b-9e06-a7e77857fec6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd] added
Nov 13 17:56:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3399ee6-802f-45a0-8a9f-e2beefcfde4d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a06ff6-7bfa-47ea-a40e-c6fa3051d77e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bIkWgSlG {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bIkWgSlG" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[548e3d10-d97b-434f-bf6f-b50afe534a9b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bIkWgSlG'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[213a81d1-3897-4314-80ec-445439042d26]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ba6c9b-0c63-46d5-ae15-f402c11d79a7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:56:06 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:56:06 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:56:06 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 17:56:06 user nova-compute[75100]: 
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6846fd56-b2b2-42e3-9576-978a54fdf227]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260]
Nov 13 17:56:06 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260] successful.
Nov 13 17:56:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa82eee5-88fe-4ed3-bfaa-9a031d4762f6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bed7008-8b38-497e-9cad-9f82adeae803]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 17:56:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 17:56:06 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0cc254-e421-4393-ab56-ed634ad8468e]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:06 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIkWgSlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26562666633396662', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562666633396662', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1626629269',display_name='tempest-TestShelveInstance-server-1626629269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1626629269',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsO2+svq2aHOHNqypywUojMJSHBecm8XoVKgLjt/TpBnQ6qv+wLJmtPDlW0tzSqu3yERb/Ctxs8pYKVQHBSkxGoWRruh6LtZEZIcU7GFDbRWNyTFKGYpNbqUprSAWUg0Q==',key_name='tempest-TestShelveInstance-202211431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a971df2b049448da3b45ae289e2865c',ramdisk_id='',reservation_id='r-9ne2dczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-747882360',owner_user_name='tempest-TestShelveInstance-747882360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:56:02Z,user_data=None,user_id='6ba7a5969e5d401ba2963a91ecc29682',uuid=ee62ff36-6731-4a1c-9536-00b8e55a63e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Converting VIF {"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG nova.objects.instance [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lazy-loading 'pci_devices' on Instance uuid ee62ff36-6731-4a1c-9536-00b8e55a63e8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:56:07 user nova-compute[75100]:   <uuid>ee62ff36-6731-4a1c-9536-00b8e55a63e8</uuid>
Nov 13 17:56:07 user nova-compute[75100]:   <name>instance-00000034</name>
Nov 13 17:56:07 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:56:07 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:56:07 user nova-compute[75100]:   <metadata>
Nov 13 17:56:07 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:56:07 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:56:07 user nova-compute[75100]:       <nova:name>tempest-TestShelveInstance-server-1626629269</nova:name>
Nov 13 17:56:07 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:56:05</nova:creationTime>
Nov 13 17:56:07 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:56:07 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:56:07 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:56:07 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:56:07 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:56:07 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:56:07 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:56:07 user nova-compute[75100]:       <nova:owner>
Nov 13 17:56:07 user nova-compute[75100]:         <nova:user uuid="6ba7a5969e5d401ba2963a91ecc29682">tempest-TestShelveInstance-747882360-project-member</nova:user>
Nov 13 17:56:07 user nova-compute[75100]:         <nova:project uuid="9a971df2b049448da3b45ae289e2865c">tempest-TestShelveInstance-747882360</nova:project>
Nov 13 17:56:07 user nova-compute[75100]:       </nova:owner>
Nov 13 17:56:07 user nova-compute[75100]:       <nova:ports>
Nov 13 17:56:07 user nova-compute[75100]:         <nova:port uuid="b49b04b3-fb0d-4572-a83d-a7a023e0f158">
Nov 13 17:56:07 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 17:56:07 user nova-compute[75100]:         </nova:port>
Nov 13 17:56:07 user nova-compute[75100]:       </nova:ports>
Nov 13 17:56:07 user nova-compute[75100]:     </nova:instance>
Nov 13 17:56:07 user nova-compute[75100]:   </metadata>
Nov 13 17:56:07 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:56:07 user nova-compute[75100]:     <system>
Nov 13 17:56:07 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:56:07 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:56:07 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:56:07 user nova-compute[75100]:       <entry name="serial">ee62ff36-6731-4a1c-9536-00b8e55a63e8</entry>
Nov 13 17:56:07 user nova-compute[75100]:       <entry name="uuid">ee62ff36-6731-4a1c-9536-00b8e55a63e8</entry>
Nov 13 17:56:07 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:56:07 user nova-compute[75100]:     </system>
Nov 13 17:56:07 user nova-compute[75100]:   </sysinfo>
Nov 13 17:56:07 user nova-compute[75100]:   <os>
Nov 13 17:56:07 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:56:07 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:56:07 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:56:07 user nova-compute[75100]:   </os>
Nov 13 17:56:07 user nova-compute[75100]:   <features>
Nov 13 17:56:07 user nova-compute[75100]:     <acpi/>
Nov 13 17:56:07 user nova-compute[75100]:     <apic/>
Nov 13 17:56:07 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:56:07 user nova-compute[75100]:   </features>
Nov 13 17:56:07 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:56:07 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:56:07 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:56:07 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:56:07 user nova-compute[75100]:   </clock>
Nov 13 17:56:07 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:56:07 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:56:07 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:56:07 user nova-compute[75100]:   </cpu>
Nov 13 17:56:07 user nova-compute[75100]:   <devices>
Nov 13 17:56:07 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:56:07 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:56:07 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 13 17:56:07 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:56:07 user nova-compute[75100]:       <serial>b4106100-9141-4e17-82b8-3445f97da7cd</serial>
Nov 13 17:56:07 user nova-compute[75100]:     </disk>
Nov 13 17:56:07 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:56:07 user nova-compute[75100]:       <mac address="fa:16:3e:bd:ed:d3"/>
Nov 13 17:56:07 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:56:07 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:56:07 user nova-compute[75100]:       <target dev="tapb49b04b3-fb"/>
Nov 13 17:56:07 user nova-compute[75100]:     </interface>
Nov 13 17:56:07 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:56:07 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/ee62ff36-6731-4a1c-9536-00b8e55a63e8/console.log" append="off"/>
Nov 13 17:56:07 user nova-compute[75100]:     </serial>
Nov 13 17:56:07 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:56:07 user nova-compute[75100]:     <video>
Nov 13 17:56:07 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:56:07 user nova-compute[75100]:     </video>
Nov 13 17:56:07 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:56:07 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:56:07 user nova-compute[75100]:     </rng>
Nov 13 17:56:07 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:56:07 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:56:07 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:56:07 user nova-compute[75100]:     </memballoon>
Nov 13 17:56:07 user nova-compute[75100]:   </devices>
Nov 13 17:56:07 user nova-compute[75100]: </domain>
Nov 13 17:56:07 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1626629269',display_name='tempest-TestShelveInstance-server-1626629269',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1626629269',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsO2+svq2aHOHNqypywUojMJSHBecm8XoVKgLjt/TpBnQ6qv+wLJmtPDlW0tzSqu3yERb/Ctxs8pYKVQHBSkxGoWRruh6LtZEZIcU7GFDbRWNyTFKGYpNbqUprSAWUg0Q==',key_name='tempest-TestShelveInstance-202211431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a971df2b049448da3b45ae289e2865c',ramdisk_id='',reservation_id='r-9ne2dczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-747882360',owner_user_name='tempest-TestShelveInstance-747882360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T17:56:02Z,user_data=None,user_id='6ba7a5969e5d401ba2963a91ecc29682',uuid=ee62ff36-6731-4a1c-9536-00b8e55a63e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Converting VIF {"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG os_vif [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8375c8c0-bece-597c-ad12-bf6046a6a2fd', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb49b04b3-fb, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb49b04b3-fb, col_values=(('qos', UUID('793f8428-7ac6-45c0-858e-ac006a9c7e10')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb49b04b3-fb, col_values=(('external_ids', {'iface-id': 'b49b04b3-fb0d-4572-a83d-a7a023e0f158', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:ed:d3', 'vm-uuid': 'ee62ff36-6731-4a1c-9536-00b8e55a63e8'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:07 user nova-compute[75100]: INFO os_vif [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb')
Nov 13 17:56:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:56:07 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] No VIF found with MAC fa:16:3e:bd:ed:d3, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:56:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-0ff485d2-4e31-4318-b607-59ab8fbdca14 req-2a31a27f-9adc-4cb0-a9da-ce7ed80a665e service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:56:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0ff485d2-4e31-4318-b607-59ab8fbdca14 req-2a31a27f-9adc-4cb0-a9da-ce7ed80a665e service nova] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:56:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0ff485d2-4e31-4318-b607-59ab8fbdca14 req-2a31a27f-9adc-4cb0-a9da-ce7ed80a665e service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:56:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0ff485d2-4e31-4318-b607-59ab8fbdca14 req-2a31a27f-9adc-4cb0-a9da-ce7ed80a665e service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:56:08 user nova-compute[75100]: DEBUG nova.compute.manager [req-0ff485d2-4e31-4318-b607-59ab8fbdca14 req-2a31a27f-9adc-4cb0-a9da-ce7ed80a665e service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] No waiting events found dispatching network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:56:08 user nova-compute[75100]: WARNING nova.compute.manager [req-0ff485d2-4e31-4318-b607-59ab8fbdca14 req-2a31a27f-9adc-4cb0-a9da-ce7ed80a665e service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received unexpected event network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 for instance with vm_state building and task_state spawning.
Nov 13 17:56:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:09 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:56:10 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Instance spawned successfully.
Nov 13 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:56:10 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 17:56:10 user nova-compute[75100]: INFO nova.compute.manager [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 13 17:56:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:56:10 user nova-compute[75100]: INFO nova.compute.manager [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Took 9.66 seconds to build instance.
Nov 13 17:56:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-7afb9e33-a0d4-4d82-a371-5acc3b989a45 req-7b46873d-d749-425b-9be4-a1f5af596a91 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7afb9e33-a0d4-4d82-a371-5acc3b989a45 req-7b46873d-d749-425b-9be4-a1f5af596a91 service nova] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7afb9e33-a0d4-4d82-a371-5acc3b989a45 req-7b46873d-d749-425b-9be4-a1f5af596a91 service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7afb9e33-a0d4-4d82-a371-5acc3b989a45 req-7b46873d-d749-425b-9be4-a1f5af596a91 service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:56:10 user nova-compute[75100]: DEBUG nova.compute.manager [req-7afb9e33-a0d4-4d82-a371-5acc3b989a45 req-7b46873d-d749-425b-9be4-a1f5af596a91 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] No waiting events found dispatching network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:56:10 user nova-compute[75100]: WARNING nova.compute.manager [req-7afb9e33-a0d4-4d82-a371-5acc3b989a45 req-7b46873d-d749-425b-9be4-a1f5af596a91 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received unexpected event network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 for instance with vm_state active and task_state None.
Nov 13 17:56:10 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-1c5c60dc-97a4-42a0-8490-6040064ed9ca tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.766s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:56:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:56:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-f40e1311-a4da-44e9-bac5-2df0cee790ef req-c8ef90ad-5a15-4347-9416-62328862d1d0 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Received event network-changed-4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:56:23 user nova-compute[75100]: DEBUG nova.compute.manager [req-f40e1311-a4da-44e9-bac5-2df0cee790ef req-c8ef90ad-5a15-4347-9416-62328862d1d0 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Refreshing instance network info cache due to event network-changed-4535b571-1e31-4e30-8233-6d78e7f7a8b9. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f40e1311-a4da-44e9-bac5-2df0cee790ef req-c8ef90ad-5a15-4347-9416-62328862d1d0 service nova] Acquiring lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f40e1311-a4da-44e9-bac5-2df0cee790ef req-c8ef90ad-5a15-4347-9416-62328862d1d0 service nova] Acquired lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:56:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-f40e1311-a4da-44e9-bac5-2df0cee790ef req-c8ef90ad-5a15-4347-9416-62328862d1d0 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Refreshing network info cache for port 4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:56:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-f40e1311-a4da-44e9-bac5-2df0cee790ef req-c8ef90ad-5a15-4347-9416-62328862d1d0 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updated VIF entry in instance network info cache for port 4535b571-1e31-4e30-8233-6d78e7f7a8b9. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:56:23 user nova-compute[75100]: DEBUG nova.network.neutron [req-f40e1311-a4da-44e9-bac5-2df0cee790ef req-c8ef90ad-5a15-4347-9416-62328862d1d0 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updating instance_info_cache with network_info: [{"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:56:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-f40e1311-a4da-44e9-bac5-2df0cee790ef req-c8ef90ad-5a15-4347-9416-62328862d1d0 service nova] Releasing lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lazy-loading 'flavor' on Instance uuid 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:56:26 user nova-compute[75100]: INFO nova.compute.manager [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Attaching volume ec0452d7-5ac7-4613-952e-f9d4653e568e to /dev/vdb
Nov 13 17:56:26 user nova-compute[75100]: DEBUG os_brick.utils [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eb9c51-37cf-4801-a50a-692c83c139b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[de602dd4-e89d-4926-be5b-adfc5240b36a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a90e037-a08b-421d-a42f-cad4c4ac8cda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4382c72e-c7de-46ca-86c7-ba757d30f61c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:56:26 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:56:26 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b69c99-1014-4d63-8c09-70bcf88bea4f]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG os_brick.utils [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:56:26 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updating existing volume attachment record: cacdc71d-2caf-4075-843d-4571589aac7a {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:56:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:56:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 17:56:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycaobsSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:56:30 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:56:30 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:56:30 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3883abef-477e-489b-8527-0311a78866ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:56:30 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd7aed0-5e22-4b10-80b3-3fc0bf5ce983]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e] added
Nov 13 17:56:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadeb8d6-dcc3-4a02-a44b-45791cbf9ed5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab04f0b-370c-4645-b44f-9d0ca2a03491]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycaobsSK {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycaobsSK" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6bb7e8-6d13-48e4-ad7f-d423946ef449]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycaobsSK'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8747386-4f72-46b1-9c46-376ecc4c095b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0e6abf-9d82-4d77-986c-81f815154fe6]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 17:56:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 17:56:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22192eb-6d24-4683-8e18-2478c27b56e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e, portal: 172.16.0.220,3260]
Nov 13 17:56:30 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e, portal: 172.16.0.220,3260] successful.
Nov 13 17:56:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e162531b-697c-4c4c-a628-fc294068410d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6494907c-1392-42f4-8be5-d3b59ee0f119]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 17:56:30 user nova-compute[75100]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e (non-flash)
Nov 13 17:56:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 17:56:30 user nova-compute[75100]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e (non-flash)
Nov 13 17:56:30 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aaa22e-184d-460f-a66e-cfda1f4f8f59]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:30 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:56:31 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:56:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycaobsSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:56:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:56:31 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23735666162323333', 'path': '/dev/sdc'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:56:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735666162323333', 'path': '/dev/sdc'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:56:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lazy-loading 'flavor' on Instance uuid 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:56:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 17:56:31 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:56:31 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 13 17:56:31 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:56:31 user nova-compute[75100]:   <serial>ec0452d7-5ac7-4613-952e-f9d4653e568e</serial>
Nov 13 17:56:31 user nova-compute[75100]: </disk>
Nov 13 17:56:31 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 17:56:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:56:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:56:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] No VIF found with MAC fa:16:3e:31:da:72, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:56:32 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b21151e6-728c-445b-a4ab-096f781d47a0 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.056s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:56:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:56:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:56:33 user nova-compute[75100]: INFO nova.compute.manager [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Detaching volume ec0452d7-5ac7-4613-952e-f9d4653e568e
Nov 13 17:56:33 user nova-compute[75100]: INFO nova.virt.block_device [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Attempting to driver detach volume ec0452d7-5ac7-4613-952e-f9d4653e568e from mountpoint /dev/vdb
Nov 13 17:56:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Attempting to detach device vdb from instance 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 17:56:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:56:33 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:56:33 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 13 17:56:33 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:56:33 user nova-compute[75100]:   <serial>ec0452d7-5ac7-4613-952e-f9d4653e568e</serial>
Nov 13 17:56:33 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:56:33 user nova-compute[75100]: </disk>
Nov 13 17:56:33 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:56:33 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Successfully detached device vdb from instance 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 from the persistent domain config.
Nov 13 17:56:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 17:56:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 17:56:33 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:56:33 user nova-compute[75100]:   <source dev="/dev/sdc"/>
Nov 13 17:56:33 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 17:56:33 user nova-compute[75100]:   <serial>ec0452d7-5ac7-4613-952e-f9d4653e568e</serial>
Nov 13 17:56:33 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 17:56:33 user nova-compute[75100]: </disk>
Nov 13 17:56:33 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 17:56:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 17:56:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:43 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:56:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:56:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:56:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:56:45 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:56:45 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updating instance_info_cache with network_info: [{"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:56:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-9ec6fa62-91bd-4785-bb4c-7d495f1cf701" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:56:45 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:56:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:56:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:56:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:56:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:48 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:56:49 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:56:49 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:56:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=25.020435333251953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:56:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:56:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ee62ff36-6731-4a1c-9536-00b8e55a63e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:56:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:56:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:56:49 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:56:49 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:56:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:56:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:56:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:56:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:56:54 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 is timed out.
Nov 13 17:56:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Successfully detached device vdb from instance 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 from the live domain config.
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycaobsSK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:56:54 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e34e4a-40f5-43a7-80ab-4e125e9cc02f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:56:54 user nova-compute[75100]: No targets found.
Nov 13 17:56:54 user nova-compute[75100]: iSNS:
Nov 13 17:56:54 user nova-compute[75100]: No targets found.
Nov 13 17:56:54 user nova-compute[75100]: STATIC:
Nov 13 17:56:54 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e
Nov 13 17:56:54 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:56:54 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:56:54 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd
Nov 13 17:56:54 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:56:54 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:56:54 user nova-compute[75100]: FIRMWARE:
Nov 13 17:56:54 user nova-compute[75100]: No targets found.
Nov 13 17:56:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:56:54 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:56:54 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f4fe5-fb93-46eb-8f84-296ef2aa361a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edc0ca4-e44d-4061-815b-6bd8904cfbe2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 17:56:54 user nova-compute[75100]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e (non-flash)
Nov 13 17:56:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 17:56:54 user nova-compute[75100]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e (non-flash)
Nov 13 17:56:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda7c2205e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e'): ({'sdc'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Removing single pathed devices sdc {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d978506b-70e4-4a62-a4c0-39326aa58515]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d69f24-13ca-4ac7-9c91-a5f8a6e74727]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Flushing IO for device /dev/sdc {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b505479-ebb5-409d-aa2f-830c2ede9ae4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6a7d09-70e0-4277-93ec-d23c8d6239c5]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] SCSI volumes sdc have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c02eeea-144f-45ad-b50b-d080141eebc9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e787062-d693-4c86-af84-985173c45ee3]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e, portal: 172.16.0.220,3260]
Nov 13 17:56:54 user nova-compute[75100]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e, portal: 172.16.0.220,3260] successful.
Nov 13 17:56:54 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec0452d7-5ac7-4613-952e-f9d4653e568e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8885235f-356e-4927-ac8c-a84748144be2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] <== disconnect_volume: return (290ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:56:54 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:56:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lazy-loading 'flavor' on Instance uuid 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:56:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-8d76e758-68a7-4b8b-b8ce-214942e6bf26 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.717s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:56:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:56:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:56:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:56:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:57:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:57:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:57:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:57:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:57:07 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid ee62ff36-6731-4a1c-9536-00b8e55a63e8 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 17:57:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:07 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:08 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:57:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:25 user nova-compute[75100]: INFO nova.compute.manager [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Terminating instance
Nov 13 17:57:25 user nova-compute[75100]: DEBUG nova.compute.manager [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-0e7edb86-8b6b-47bd-9f01-7fc6d48a1dd7 req-f37edad5-eaca-4924-b941-01f01a1736c7 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Received event network-vif-unplugged-4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0e7edb86-8b6b-47bd-9f01-7fc6d48a1dd7 req-f37edad5-eaca-4924-b941-01f01a1736c7 service nova] Acquiring lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0e7edb86-8b6b-47bd-9f01-7fc6d48a1dd7 req-f37edad5-eaca-4924-b941-01f01a1736c7 service nova] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0e7edb86-8b6b-47bd-9f01-7fc6d48a1dd7 req-f37edad5-eaca-4924-b941-01f01a1736c7 service nova] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-0e7edb86-8b6b-47bd-9f01-7fc6d48a1dd7 req-f37edad5-eaca-4924-b941-01f01a1736c7 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] No waiting events found dispatching network-vif-unplugged-4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:57:25 user nova-compute[75100]: DEBUG nova.compute.manager [req-0e7edb86-8b6b-47bd-9f01-7fc6d48a1dd7 req-f37edad5-eaca-4924-b941-01f01a1736c7 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Received event network-vif-unplugged-4535b571-1e31-4e30-8233-6d78e7f7a8b9 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Instance destroyed successfully.
Nov 13 17:57:26 user nova-compute[75100]: DEBUG nova.objects.instance [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lazy-loading 'resources' on Instance uuid 9ec6fa62-91bd-4785-bb4c-7d495f1cf701 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1084218230',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1084218230',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1084218',id=51,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9rG2MqgVO6LUgtT6mvCU8/ZwPZWGIpwtkVjGECN+tXVXKvlubn5ui6hkm0OrIfPtuejrFm5CkoPkTGC+lrWlOhzm9z4dz7TFGpUNZsXhUFMnAqayLd4UyLxmsk2UOXKA==',key_name='tempest-keypair-2088622896',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:54:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fef1b4c8ac314b159703a41a5ada29be',ramdisk_id='',reservation_id='r-6eb42l3f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-900640539',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:54:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6fdcb492bec34312b18321d97ef89d9e',uuid=9ec6fa62-91bd-4785-bb4c-7d495f1cf701,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Converting VIF {"id": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "address": "fa:16:3e:31:da:72", "network": {"id": "650797c3-2232-4770-bca8-b570651d4e29", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1064614861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fef1b4c8ac314b159703a41a5ada29be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4535b571-1e", "ovs_interfaceid": "4535b571-1e31-4e30-8233-6d78e7f7a8b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:da:72,bridge_name='br-int',has_traffic_filtering=True,id=4535b571-1e31-4e30-8233-6d78e7f7a8b9,network=Network(650797c3-2232-4770-bca8-b570651d4e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4535b571-1e') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG os_vif [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:da:72,bridge_name='br-int',has_traffic_filtering=True,id=4535b571-1e31-4e30-8233-6d78e7f7a8b9,network=Network(650797c3-2232-4770-bca8-b570651d4e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4535b571-1e') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4535b571-1e, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=492bf6f9-282d-42f0-9ad1-60b5d3838ee3) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:57:26 user nova-compute[75100]: INFO os_vif [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:da:72,bridge_name='br-int',has_traffic_filtering=True,id=4535b571-1e31-4e30-8233-6d78e7f7a8b9,network=Network(650797c3-2232-4770-bca8-b570651d4e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4535b571-1e')
Nov 13 17:57:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Deleting instance files /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701_del
Nov 13 17:57:26 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Deletion of /opt/stack/data/nova/instances/9ec6fa62-91bd-4785-bb4c-7d495f1cf701_del complete
Nov 13 17:57:26 user nova-compute[75100]: INFO nova.compute.manager [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 17:57:26 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 17:57:26 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 17:57:27 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:57:27 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Took 0.92 seconds to deallocate network for instance.
Nov 13 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-d91ac014-ab1b-4c28-adc3-d34e5dbe4f51 req-c2da312b-5317-4ad4-a052-a0e0e4cf5509 service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Received event network-vif-deleted-4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:57:27 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:57:27 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:27 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Deleted allocations for instance 9ec6fa62-91bd-4785-bb4c-7d495f1cf701
Nov 13 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-eb345fdd-e96c-4e22-b191-3f5a737a1e59 tempest-TestServerVolumeAttachScenarioOldVersion-900640539 tempest-TestServerVolumeAttachScenarioOldVersion-900640539-project-member] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.128s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-7ef9ff36-33b6-4cd1-b106-c5a67f0f89e6 req-90bba210-9a8d-438c-9bc6-eb6c0ff8365e service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Received event network-vif-plugged-4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7ef9ff36-33b6-4cd1-b106-c5a67f0f89e6 req-90bba210-9a8d-438c-9bc6-eb6c0ff8365e service nova] Acquiring lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7ef9ff36-33b6-4cd1-b106-c5a67f0f89e6 req-90bba210-9a8d-438c-9bc6-eb6c0ff8365e service nova] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:27 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-7ef9ff36-33b6-4cd1-b106-c5a67f0f89e6 req-90bba210-9a8d-438c-9bc6-eb6c0ff8365e service nova] Lock "9ec6fa62-91bd-4785-bb4c-7d495f1cf701-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:27 user nova-compute[75100]: DEBUG nova.compute.manager [req-7ef9ff36-33b6-4cd1-b106-c5a67f0f89e6 req-90bba210-9a8d-438c-9bc6-eb6c0ff8365e service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] No waiting events found dispatching network-vif-plugged-4535b571-1e31-4e30-8233-6d78e7f7a8b9 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:57:27 user nova-compute[75100]: WARNING nova.compute.manager [req-7ef9ff36-33b6-4cd1-b106-c5a67f0f89e6 req-90bba210-9a8d-438c-9bc6-eb6c0ff8365e service nova] [instance: 9ec6fa62-91bd-4785-bb4c-7d495f1cf701] Received unexpected event network-vif-plugged-4535b571-1e31-4e30-8233-6d78e7f7a8b9 for instance with vm_state deleted and task_state None.
Nov 13 17:57:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:57:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:57:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:57:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:57:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:57:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:57:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:57:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:57:47 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 17:57:47 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating instance_info_cache with network_info: [{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:57:47 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:57:47 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 17:57:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:57:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:57:48 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 17:57:49 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:57:49 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:57:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=25.04753875732422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:57:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ee62ff36-6731-4a1c-9536-00b8e55a63e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 17:57:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:57:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:57:49 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:57:49 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:57:49 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:57:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-ea34d4b2-1c08-4661-b452-449a01f28df4 req-b69aa868-2301-40bb-864b-ef96638f0563 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-changed-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-ea34d4b2-1c08-4661-b452-449a01f28df4 req-b69aa868-2301-40bb-864b-ef96638f0563 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Refreshing instance network info cache due to event network-changed-b49b04b3-fb0d-4572-a83d-a7a023e0f158. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ea34d4b2-1c08-4661-b452-449a01f28df4 req-b69aa868-2301-40bb-864b-ef96638f0563 service nova] Acquiring lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ea34d4b2-1c08-4661-b452-449a01f28df4 req-b69aa868-2301-40bb-864b-ef96638f0563 service nova] Acquired lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-ea34d4b2-1c08-4661-b452-449a01f28df4 req-b69aa868-2301-40bb-864b-ef96638f0563 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Refreshing network info cache for port b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-ea34d4b2-1c08-4661-b452-449a01f28df4 req-b69aa868-2301-40bb-864b-ef96638f0563 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updated VIF entry in instance network info cache for port b49b04b3-fb0d-4572-a83d-a7a023e0f158. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG nova.network.neutron [req-ea34d4b2-1c08-4661-b452-449a01f28df4 req-b69aa868-2301-40bb-864b-ef96638f0563 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating instance_info_cache with network_info: [{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-ea34d4b2-1c08-4661-b452-449a01f28df4 req-b69aa868-2301-40bb-864b-ef96638f0563 service nova] Releasing lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:53 user nova-compute[75100]: INFO nova.compute.manager [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Shelve offloading
Nov 13 17:57:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-a6fbadf9-0639-46cd-b6fc-2dc626705d4f req-217dd8a6-3163-4c64-a9c2-58e7c90c7766 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-vif-unplugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a6fbadf9-0639-46cd-b6fc-2dc626705d4f req-217dd8a6-3163-4c64-a9c2-58e7c90c7766 service nova] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a6fbadf9-0639-46cd-b6fc-2dc626705d4f req-217dd8a6-3163-4c64-a9c2-58e7c90c7766 service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-a6fbadf9-0639-46cd-b6fc-2dc626705d4f req-217dd8a6-3163-4c64-a9c2-58e7c90c7766 service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:53 user nova-compute[75100]: DEBUG nova.compute.manager [req-a6fbadf9-0639-46cd-b6fc-2dc626705d4f req-217dd8a6-3163-4c64-a9c2-58e7c90c7766 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] No waiting events found dispatching network-vif-unplugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:57:53 user nova-compute[75100]: WARNING nova.compute.manager [req-a6fbadf9-0639-46cd-b6fc-2dc626705d4f req-217dd8a6-3163-4c64-a9c2-58e7c90c7766 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received unexpected event network-vif-unplugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 for instance with vm_state active and task_state shelving.
Nov 13 17:57:54 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Instance destroyed successfully.
Nov 13 17:57:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:57:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:57:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquired lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:57:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:57:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:57:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating instance_info_cache with network_info: [{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:57:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Releasing lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:57:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Instance destroyed successfully.
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lazy-loading 'resources' on Instance uuid ee62ff36-6731-4a1c-9536-00b8e55a63e8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T17:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1626629269',display_name='tempest-TestShelveInstance-server-1626629269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1626629269',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsO2+svq2aHOHNqypywUojMJSHBecm8XoVKgLjt/TpBnQ6qv+wLJmtPDlW0tzSqu3yERb/Ctxs8pYKVQHBSkxGoWRruh6LtZEZIcU7GFDbRWNyTFKGYpNbqUprSAWUg0Q==',key_name='tempest-TestShelveInstance-202211431',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a971df2b049448da3b45ae289e2865c',ramdisk_id='',reservation_id='r-9ne2dczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-747882360',owner_user_name='tempest-TestShelveInstance-747882360-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:56:11Z,user_data=None,user_id='6ba7a5969e5d401ba2963a91ecc29682',uuid=ee62ff36-6731-4a1c-9536-00b8e55a63e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Converting VIF {"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_vif [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb49b04b3-fb, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=793f8428-7ac6-45c0-858e-ac006a9c7e10) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:57:55 user nova-compute[75100]: INFO os_vif [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb')
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIkWgSlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:57:55 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ef4cbc-ec43-4631-8187-19c79f798ddb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 17:57:55 user nova-compute[75100]: No targets found.
Nov 13 17:57:55 user nova-compute[75100]: iSNS:
Nov 13 17:57:55 user nova-compute[75100]: No targets found.
Nov 13 17:57:55 user nova-compute[75100]: STATIC:
Nov 13 17:57:55 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd
Nov 13 17:57:55 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 17:57:55 user nova-compute[75100]:                 Iface Name: default
Nov 13 17:57:55 user nova-compute[75100]: FIRMWARE:
Nov 13 17:57:55 user nova-compute[75100]: No targets found.
Nov 13 17:57:55 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 17:57:55 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 17:57:55 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93d3852-2576-45a2-9645-179f5c35e46e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f946643-de19-4b32-9123-4062a9c3cc81 req-c1c8c753-89db-42ac-b3e6-06c41a10c5c5 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-changed-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-5f946643-de19-4b32-9123-4062a9c3cc81 req-c1c8c753-89db-42ac-b3e6-06c41a10c5c5 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Refreshing instance network info cache due to event network-changed-b49b04b3-fb0d-4572-a83d-a7a023e0f158. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f946643-de19-4b32-9123-4062a9c3cc81 req-c1c8c753-89db-42ac-b3e6-06c41a10c5c5 service nova] Acquiring lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f946643-de19-4b32-9123-4062a9c3cc81 req-c1c8c753-89db-42ac-b3e6-06c41a10c5c5 service nova] Acquired lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-5f946643-de19-4b32-9123-4062a9c3cc81 req-c1c8c753-89db-42ac-b3e6-06c41a10c5c5 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Refreshing network info cache for port b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4846be12-aaf4-4e61-bc50-763e438a32b5]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 17:57:55 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 17:57:55 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c4c3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[177353b6-0471-4747-9b8a-2badaeb713d6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb99919-232b-42a7-961f-968ca79d16d7]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[145aa33b-4c40-4f5f-92c5-8a64251b536a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe94c7a-2314-467c-9fba-78c5c638935a]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9beb7f-cb6a-45c1-a855-290f2778ac0c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[94744aa6-1192-40bf-896b-b4a37798ea17]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260]
Nov 13 17:57:55 user nova-compute[75100]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260] successful.
Nov 13 17:57:55 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6776d6-57bc-4144-bcac-70e25f52c75e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] <== disconnect_volume: return (268ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 17:57:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Deleting instance files /opt/stack/data/nova/instances/ee62ff36-6731-4a1c-9536-00b8e55a63e8_del
Nov 13 17:57:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Deletion of /opt/stack/data/nova/instances/ee62ff36-6731-4a1c-9536-00b8e55a63e8_del complete
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-5f946643-de19-4b32-9123-4062a9c3cc81 req-c1c8c753-89db-42ac-b3e6-06c41a10c5c5 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updated VIF entry in instance network info cache for port b49b04b3-fb0d-4572-a83d-a7a023e0f158. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.network.neutron [req-5f946643-de19-4b32-9123-4062a9c3cc81 req-c1c8c753-89db-42ac-b3e6-06c41a10c5c5 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating instance_info_cache with network_info: [{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": null, "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-5f946643-de19-4b32-9123-4062a9c3cc81 req-c1c8c753-89db-42ac-b3e6-06c41a10c5c5 service nova] Releasing lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-2b5cf5de-4322-4182-9d81-d284f578dbce req-8f50abf1-1871-44ab-88aa-908797a07a21 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2b5cf5de-4322-4182-9d81-d284f578dbce req-8f50abf1-1871-44ab-88aa-908797a07a21 service nova] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2b5cf5de-4322-4182-9d81-d284f578dbce req-8f50abf1-1871-44ab-88aa-908797a07a21 service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2b5cf5de-4322-4182-9d81-d284f578dbce req-8f50abf1-1871-44ab-88aa-908797a07a21 service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:55 user nova-compute[75100]: DEBUG nova.compute.manager [req-2b5cf5de-4322-4182-9d81-d284f578dbce req-8f50abf1-1871-44ab-88aa-908797a07a21 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] No waiting events found dispatching network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:57:55 user nova-compute[75100]: WARNING nova.compute.manager [req-2b5cf5de-4322-4182-9d81-d284f578dbce req-8f50abf1-1871-44ab-88aa-908797a07a21 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received unexpected event network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 for instance with vm_state active and task_state shelving.
Nov 13 17:57:56 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Deleted allocations for instance ee62ff36-6731-4a1c-9536-00b8e55a63e8
Nov 13 17:57:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:57:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:57:56 user nova-compute[75100]: DEBUG nova.objects.instance [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lazy-loading 'numa_topology' on Instance uuid ee62ff36-6731-4a1c-9536-00b8e55a63e8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:57:56 user nova-compute[75100]: DEBUG nova.objects.base [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Object Instance<ee62ff36-6731-4a1c-9536-00b8e55a63e8> lazy-loaded attributes: resources,numa_topology {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:57:56 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:57:56 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:57:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.099s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-30a35c7f-729a-49c5-8686-2ba435c8a625 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.277s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:57:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:57:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:57:59 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:58:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:58:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:58:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:58:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:58:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:58:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:58:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:58:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:45 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:58:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:58:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:58:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:58:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:58:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:58:48 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:58:48 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:58:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=9142MB free_disk=25.046268463134766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:58:48 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:58:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:58:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:58:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:58:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 17:58:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:58:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:58:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:58:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:58:55 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:58:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:59:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:59:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:59:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 17:59:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:59:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:59:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:59:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:59:00 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:05 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:10 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:59:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:59:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:59:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:59:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:59:25 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:59:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:59:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 17:59:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:59:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 17:59:40 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:59:45 user nova-compute[75100]: INFO nova.compute.manager [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Unshelving
Nov 13 17:59:45 user nova-compute[75100]: INFO nova.virt.block_device [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Booting with volume b4106100-9141-4e17-82b8-3445f97da7cd at /dev/vda
Nov 13 17:59:45 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG os_brick.utils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30f2d24-5838-43af-9ff4-7f3404ad3eef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95da466-7e30-432f-8308-db2e8bc8816b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1d55ff-4b4b-4b36-af89-a81f55d42324]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[536326c5-a129-4bf8-8ae8-fd1060a2f040]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 17:59:45 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 17:59:45 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df3803c-beae-4394-917f-721ceb6ceedd]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG os_brick.utils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:59:45 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating existing volume attachment record: 5d305166-ed74-4713-ae75-af48725b7ed0 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 17:59:47 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:59:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:59:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 17:59:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 17:59:49 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 17:59:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:59:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:59:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:59:49 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lazy-loading 'pci_requests' on Instance uuid ee62ff36-6731-4a1c-9536-00b8e55a63e8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:59:49 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lazy-loading 'numa_topology' on Instance uuid ee62ff36-6731-4a1c-9536-00b8e55a63e8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:59:49 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 17:59:49 user nova-compute[75100]: INFO nova.compute.claims [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Claim successful on node user
Nov 13 17:59:49 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:59:49 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:59:49 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:59:49 user nova-compute[75100]: INFO nova.network.neutron [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating port b49b04b3-fb0d-4572-a83d-a7a023e0f158 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquired lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-4d976019-4fe2-4d03-943f-f362e9b17928 req-df4ac00f-a022-4326-81f0-fe56bc87b91e service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-changed-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG nova.compute.manager [req-4d976019-4fe2-4d03-943f-f362e9b17928 req-df4ac00f-a022-4326-81f0-fe56bc87b91e service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Refreshing instance network info cache due to event network-changed-b49b04b3-fb0d-4572-a83d-a7a023e0f158. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4d976019-4fe2-4d03-943f-f362e9b17928 req-df4ac00f-a022-4326-81f0-fe56bc87b91e service nova] Acquiring lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 17:59:50 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:59:50 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:59:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=9135MB free_disk=25.037677764892578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (d0cd9ee7-47c1-40a1-b685-446f6384b590): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 17:59:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.network.neutron [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating instance_info_cache with network_info: [{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Releasing lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 17:59:51 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Creating image(s)
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Did not create local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Ensure instance console log exists: /opt/stack/data/nova/instances/ee62ff36-6731-4a1c-9536-00b8e55a63e8/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Start _get_guest_xml network_info=[{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '5d305166-ed74-4713-ae75-af48725b7ed0', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIkWgSlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee62ff36-6731-4a1c-9536-00b8e55a63e8', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4106100-9141-4e17-82b8-3445f97da7cd', 'serial': 'b4106100-9141-4e17-82b8-3445f97da7cd'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4d976019-4fe2-4d03-943f-f362e9b17928 req-df4ac00f-a022-4326-81f0-fe56bc87b91e service nova] Acquired lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-4d976019-4fe2-4d03-943f-f362e9b17928 req-df4ac00f-a022-4326-81f0-fe56bc87b91e service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Refreshing network info cache for port b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 17:59:51 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:59:51 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee62ff36-6731-4a1c-9536-00b8e55a63e8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.objects.base [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Object Instance<ee62ff36-6731-4a1c-9536-00b8e55a63e8> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIkWgSlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 17:59:51 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:59:51 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 17:59:51 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa95e0e-d1e1-484f-8244-49f989aec341]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 17:59:51 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5b247d-4971-4995-9918-895016067706]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd] added
Nov 13 17:59:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f9f8fb-eb47-422d-b7cb-60af9f919487]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe13466-f86e-4e5f-ab33-9fe40e4f99e1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bIkWgSlG {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bIkWgSlG" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f5adc-bccc-4e18-8d03-25edaba03750]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bIkWgSlG'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fa0361-077a-4893-a043-9ae598e6df20]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[44902d08-f43d-4da3-a1ee-419c090da237]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:59:51 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 17:59:51 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:59:51 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 17:59:51 user nova-compute[75100]: 
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a8f90d-e2a0-4e2c-82ed-42d211c40ce1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260]
Nov 13 17:59:51 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260] successful.
Nov 13 17:59:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0706d8f-90a4-4832-b6fd-53dd154d2244]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b59acb-6ea9-4e02-92fb-1ca7aa27d6b2]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 17:59:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 17:59:51 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[945698df-6ad3-4293-b486-25a8f81f6216]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-4d976019-4fe2-4d03-943f-f362e9b17928 req-df4ac00f-a022-4326-81f0-fe56bc87b91e service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updated VIF entry in instance network info cache for port b49b04b3-fb0d-4572-a83d-a7a023e0f158. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG nova.network.neutron [req-4d976019-4fe2-4d03-943f-f362e9b17928 req-df4ac00f-a022-4326-81f0-fe56bc87b91e service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating instance_info_cache with network_info: [{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 17:59:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-4d976019-4fe2-4d03-943f-f362e9b17928 req-df4ac00f-a022-4326-81f0-fe56bc87b91e service nova] Releasing lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIkWgSlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26562666633396662', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562666633396662', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1626629269',display_name='tempest-TestShelveInstance-server-1626629269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1626629269',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-202211431',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9a971df2b049448da3b45ae289e2865c',ramdisk_id='',reservation_id='r-9ne2dczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-747882360',owner_user_name='tempest-TestShelveInstance-747882360-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:59:45Z,user_data=None,user_id='6ba7a5969e5d401ba2963a91ecc29682',uuid=ee62ff36-6731-4a1c-9536-00b8e55a63e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Converting VIF {"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG nova.objects.instance [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lazy-loading 'pci_devices' on Instance uuid ee62ff36-6731-4a1c-9536-00b8e55a63e8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG nova.objects.base [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Object Instance<ee62ff36-6731-4a1c-9536-00b8e55a63e8> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75100) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] End _get_guest_xml xml=<domain type="kvm">
Nov 13 17:59:52 user nova-compute[75100]:   <uuid>ee62ff36-6731-4a1c-9536-00b8e55a63e8</uuid>
Nov 13 17:59:52 user nova-compute[75100]:   <name>instance-00000034</name>
Nov 13 17:59:52 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 17:59:52 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 17:59:52 user nova-compute[75100]:   <metadata>
Nov 13 17:59:52 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 17:59:52 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 17:59:52 user nova-compute[75100]:       <nova:name>tempest-TestShelveInstance-server-1626629269</nova:name>
Nov 13 17:59:52 user nova-compute[75100]:       <nova:creationTime>2023-11-13 17:59:51</nova:creationTime>
Nov 13 17:59:52 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 17:59:52 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 17:59:52 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 17:59:52 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 17:59:52 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 17:59:52 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 17:59:52 user nova-compute[75100]:       </nova:flavor>
Nov 13 17:59:52 user nova-compute[75100]:       <nova:owner>
Nov 13 17:59:52 user nova-compute[75100]:         <nova:user uuid="6ba7a5969e5d401ba2963a91ecc29682">tempest-TestShelveInstance-747882360-project-member</nova:user>
Nov 13 17:59:52 user nova-compute[75100]:         <nova:project uuid="9a971df2b049448da3b45ae289e2865c">tempest-TestShelveInstance-747882360</nova:project>
Nov 13 17:59:52 user nova-compute[75100]:       </nova:owner>
Nov 13 17:59:52 user nova-compute[75100]:       <nova:ports>
Nov 13 17:59:52 user nova-compute[75100]:         <nova:port uuid="b49b04b3-fb0d-4572-a83d-a7a023e0f158">
Nov 13 17:59:52 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 17:59:52 user nova-compute[75100]:         </nova:port>
Nov 13 17:59:52 user nova-compute[75100]:       </nova:ports>
Nov 13 17:59:52 user nova-compute[75100]:     </nova:instance>
Nov 13 17:59:52 user nova-compute[75100]:   </metadata>
Nov 13 17:59:52 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 17:59:52 user nova-compute[75100]:     <system>
Nov 13 17:59:52 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 17:59:52 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 17:59:52 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 17:59:52 user nova-compute[75100]:       <entry name="serial">ee62ff36-6731-4a1c-9536-00b8e55a63e8</entry>
Nov 13 17:59:52 user nova-compute[75100]:       <entry name="uuid">ee62ff36-6731-4a1c-9536-00b8e55a63e8</entry>
Nov 13 17:59:52 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 17:59:52 user nova-compute[75100]:     </system>
Nov 13 17:59:52 user nova-compute[75100]:   </sysinfo>
Nov 13 17:59:52 user nova-compute[75100]:   <os>
Nov 13 17:59:52 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 17:59:52 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 17:59:52 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 17:59:52 user nova-compute[75100]:   </os>
Nov 13 17:59:52 user nova-compute[75100]:   <features>
Nov 13 17:59:52 user nova-compute[75100]:     <acpi/>
Nov 13 17:59:52 user nova-compute[75100]:     <apic/>
Nov 13 17:59:52 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 17:59:52 user nova-compute[75100]:   </features>
Nov 13 17:59:52 user nova-compute[75100]:   <clock offset="utc">
Nov 13 17:59:52 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 17:59:52 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 17:59:52 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 17:59:52 user nova-compute[75100]:   </clock>
Nov 13 17:59:52 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 17:59:52 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 17:59:52 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 17:59:52 user nova-compute[75100]:   </cpu>
Nov 13 17:59:52 user nova-compute[75100]:   <devices>
Nov 13 17:59:52 user nova-compute[75100]:     <disk type="block" device="disk">
Nov 13 17:59:52 user nova-compute[75100]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 17:59:52 user nova-compute[75100]:       <source dev="/dev/sdb"/>
Nov 13 17:59:52 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 17:59:52 user nova-compute[75100]:       <serial>b4106100-9141-4e17-82b8-3445f97da7cd</serial>
Nov 13 17:59:52 user nova-compute[75100]:     </disk>
Nov 13 17:59:52 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 17:59:52 user nova-compute[75100]:       <mac address="fa:16:3e:bd:ed:d3"/>
Nov 13 17:59:52 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:59:52 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 17:59:52 user nova-compute[75100]:       <target dev="tapb49b04b3-fb"/>
Nov 13 17:59:52 user nova-compute[75100]:     </interface>
Nov 13 17:59:52 user nova-compute[75100]:     <serial type="pty">
Nov 13 17:59:52 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/ee62ff36-6731-4a1c-9536-00b8e55a63e8/console.log" append="off"/>
Nov 13 17:59:52 user nova-compute[75100]:     </serial>
Nov 13 17:59:52 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 17:59:52 user nova-compute[75100]:     <video>
Nov 13 17:59:52 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 17:59:52 user nova-compute[75100]:     </video>
Nov 13 17:59:52 user nova-compute[75100]:     <rng model="virtio">
Nov 13 17:59:52 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 17:59:52 user nova-compute[75100]:     </rng>
Nov 13 17:59:52 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 17:59:52 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 17:59:52 user nova-compute[75100]:       <stats period="10"/>
Nov 13 17:59:52 user nova-compute[75100]:     </memballoon>
Nov 13 17:59:52 user nova-compute[75100]:   </devices>
Nov 13 17:59:52 user nova-compute[75100]: </domain>
Nov 13 17:59:52 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1626629269',display_name='tempest-TestShelveInstance-server-1626629269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1626629269',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-202211431',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:56:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9a971df2b049448da3b45ae289e2865c',ramdisk_id='',reservation_id='r-9ne2dczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-747882360',owner_user_name='tempest-TestShelveInstance-747882360-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:59:45Z,user_data=None,user_id='6ba7a5969e5d401ba2963a91ecc29682',uuid=ee62ff36-6731-4a1c-9536-00b8e55a63e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Converting VIF {"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG os_vif [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8375c8c0-bece-597c-ad12-bf6046a6a2fd', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb49b04b3-fb, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb49b04b3-fb, col_values=(('qos', UUID('ce875049-cecd-49e9-8b11-3069691335d1')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb49b04b3-fb, col_values=(('external_ids', {'iface-id': 'b49b04b3-fb0d-4572-a83d-a7a023e0f158', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:ed:d3', 'vm-uuid': 'ee62ff36-6731-4a1c-9536-00b8e55a63e8'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:52 user nova-compute[75100]: INFO os_vif [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb')
Nov 13 17:59:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 17:59:52 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] No VIF found with MAC fa:16:3e:bd:ed:d3, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 17:59:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-33d37f8c-e6b6-43e8-a807-ba11c756df7c req-bccf3ccf-2dc5-4243-b54b-445d3c944e1a service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:59:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-33d37f8c-e6b6-43e8-a807-ba11c756df7c req-bccf3ccf-2dc5-4243-b54b-445d3c944e1a service nova] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:59:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-33d37f8c-e6b6-43e8-a807-ba11c756df7c req-bccf3ccf-2dc5-4243-b54b-445d3c944e1a service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:59:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-33d37f8c-e6b6-43e8-a807-ba11c756df7c req-bccf3ccf-2dc5-4243-b54b-445d3c944e1a service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:59:54 user nova-compute[75100]: DEBUG nova.compute.manager [req-33d37f8c-e6b6-43e8-a807-ba11c756df7c req-bccf3ccf-2dc5-4243-b54b-445d3c944e1a service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] No waiting events found dispatching network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:59:54 user nova-compute[75100]: WARNING nova.compute.manager [req-33d37f8c-e6b6-43e8-a807-ba11c756df7c req-bccf3ccf-2dc5-4243-b54b-445d3c944e1a service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received unexpected event network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 17:59:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:54 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:59:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 17:59:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 17:59:55 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 17:59:55 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Instance spawned successfully.
Nov 13 17:59:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 17:59:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-a6fcabb3-222e-43c9-8fb2-05e244734640 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.630s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:59:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-c4d47ddc-9a49-4b50-8a62-aeeebbbe3c8f req-4477eae6-481d-4125-9481-5df7a72d2be3 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 17:59:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c4d47ddc-9a49-4b50-8a62-aeeebbbe3c8f req-4477eae6-481d-4125-9481-5df7a72d2be3 service nova] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 17:59:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c4d47ddc-9a49-4b50-8a62-aeeebbbe3c8f req-4477eae6-481d-4125-9481-5df7a72d2be3 service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 17:59:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-c4d47ddc-9a49-4b50-8a62-aeeebbbe3c8f req-4477eae6-481d-4125-9481-5df7a72d2be3 service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 17:59:56 user nova-compute[75100]: DEBUG nova.compute.manager [req-c4d47ddc-9a49-4b50-8a62-aeeebbbe3c8f req-4477eae6-481d-4125-9481-5df7a72d2be3 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] No waiting events found dispatching network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 17:59:56 user nova-compute[75100]: WARNING nova.compute.manager [req-c4d47ddc-9a49-4b50-8a62-aeeebbbe3c8f req-4477eae6-481d-4125-9481-5df7a72d2be3 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received unexpected event network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 for instance with vm_state active and task_state None.
Nov 13 17:59:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 17:59:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:00:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:00:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:00:00 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:00:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:00:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:00:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:00:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:00:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:00:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:00:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:00:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:00:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:00:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:00:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:00:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:00:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:00:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:00:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:00:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:00:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:00:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:00:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:00:48 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:00:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:00:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:00:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:00:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:00:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:00:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:00:50 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid ee62ff36-6731-4a1c-9536-00b8e55a63e8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:00:50 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating instance_info_cache with network_info: [{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:00:50 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:00:50 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:00:50 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:00:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:00:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:00:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:00:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:00:51 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:00:51 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75100) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 18:00:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:00:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:00:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=25.03634262084961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance ee62ff36-6731-4a1c-9536-00b8e55a63e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing inventories for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating ProviderTree inventory for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating inventory in ProviderTree for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing aggregate associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing trait associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.459s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:00:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:00:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:00:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:00:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:00:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:01:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:01:02 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:01:02 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:01:02 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:01:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:01:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:01:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 18:01:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 18:01:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:01:27 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:01:27 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 18:01:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:01:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:01:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:01:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:01:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:01:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:35 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-084f144a-3b22-405d-9eb8-9af1819a73c5 req-ca059379-3501-4871-b2af-84c877fab55a service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-changed-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-084f144a-3b22-405d-9eb8-9af1819a73c5 req-ca059379-3501-4871-b2af-84c877fab55a service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Refreshing instance network info cache due to event network-changed-b49b04b3-fb0d-4572-a83d-a7a023e0f158. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-084f144a-3b22-405d-9eb8-9af1819a73c5 req-ca059379-3501-4871-b2af-84c877fab55a service nova] Acquiring lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-084f144a-3b22-405d-9eb8-9af1819a73c5 req-ca059379-3501-4871-b2af-84c877fab55a service nova] Acquired lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-084f144a-3b22-405d-9eb8-9af1819a73c5 req-ca059379-3501-4871-b2af-84c877fab55a service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Refreshing network info cache for port b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:01:36 user nova-compute[75100]: INFO nova.compute.manager [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Terminating instance
Nov 13 18:01:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a98ad1b-6e55-4cf9-b87f-b101b50c4733 req-95c24b32-ff70-47bf-a6e5-2992767a27a1 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-vif-unplugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a98ad1b-6e55-4cf9-b87f-b101b50c4733 req-95c24b32-ff70-47bf-a6e5-2992767a27a1 service nova] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a98ad1b-6e55-4cf9-b87f-b101b50c4733 req-95c24b32-ff70-47bf-a6e5-2992767a27a1 service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-2a98ad1b-6e55-4cf9-b87f-b101b50c4733 req-95c24b32-ff70-47bf-a6e5-2992767a27a1 service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a98ad1b-6e55-4cf9-b87f-b101b50c4733 req-95c24b32-ff70-47bf-a6e5-2992767a27a1 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] No waiting events found dispatching network-vif-unplugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-2a98ad1b-6e55-4cf9-b87f-b101b50c4733 req-95c24b32-ff70-47bf-a6e5-2992767a27a1 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-vif-unplugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-084f144a-3b22-405d-9eb8-9af1819a73c5 req-ca059379-3501-4871-b2af-84c877fab55a service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updated VIF entry in instance network info cache for port b49b04b3-fb0d-4572-a83d-a7a023e0f158. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG nova.network.neutron [req-084f144a-3b22-405d-9eb8-9af1819a73c5 req-ca059379-3501-4871-b2af-84c877fab55a service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating instance_info_cache with network_info: [{"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-084f144a-3b22-405d-9eb8-9af1819a73c5 req-ca059379-3501-4871-b2af-84c877fab55a service nova] Releasing lock "refresh_cache-ee62ff36-6731-4a1c-9536-00b8e55a63e8" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Instance destroyed successfully.
Nov 13 18:01:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lazy-loading 'resources' on Instance uuid ee62ff36-6731-4a1c-9536-00b8e55a63e8 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T17:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1626629269',display_name='tempest-TestShelveInstance-server-1626629269',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1626629269',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsO2+svq2aHOHNqypywUojMJSHBecm8XoVKgLjt/TpBnQ6qv+wLJmtPDlW0tzSqu3yERb/Ctxs8pYKVQHBSkxGoWRruh6LtZEZIcU7GFDbRWNyTFKGYpNbqUprSAWUg0Q==',key_name='tempest-TestShelveInstance-202211431',keypairs=<?>,launch_index=0,launched_at=2023-11-13T17:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a971df2b049448da3b45ae289e2865c',ramdisk_id='',reservation_id='r-9ne2dczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-747882360',owner_user_name='tempest-TestShelveInstance-747882360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T17:59:56Z,user_data=None,user_id='6ba7a5969e5d401ba2963a91ecc29682',uuid=ee62ff36-6731-4a1c-9536-00b8e55a63e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Converting VIF {"id": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "address": "fa:16:3e:bd:ed:d3", "network": {"id": "420827d7-0ba9-4bb7-aa58-0c90885777eb", "bridge": "br-int", "label": "tempest-TestShelveInstance-1716704663-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9a971df2b049448da3b45ae289e2865c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49b04b3-fb", "ovs_interfaceid": "b49b04b3-fb0d-4572-a83d-a7a023e0f158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_vif [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb49b04b3-fb, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce875049-cecd-49e9-8b11-3069691335d1) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:37 user nova-compute[75100]: INFO os_vif [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:ed:d3,bridge_name='br-int',has_traffic_filtering=True,id=b49b04b3-fb0d-4572-a83d-a7a023e0f158,network=Network(420827d7-0ba9-4bb7-aa58-0c90885777eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49b04b3-fb')
Nov 13 18:01:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bIkWgSlG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:01:37 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7dad98-6e94-4077-bc42-f3c666350185]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:01:37 user nova-compute[75100]: No targets found.
Nov 13 18:01:37 user nova-compute[75100]: iSNS:
Nov 13 18:01:37 user nova-compute[75100]: No targets found.
Nov 13 18:01:37 user nova-compute[75100]: STATIC:
Nov 13 18:01:37 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd
Nov 13 18:01:37 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:01:37 user nova-compute[75100]:                 Iface Name: default
Nov 13 18:01:37 user nova-compute[75100]: FIRMWARE:
Nov 13 18:01:37 user nova-compute[75100]: No targets found.
Nov 13 18:01:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:01:37 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:01:37 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[2154655c-ebd7-4133-b146-e6203fe0af75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[48760507-7e74-473c-8769-5b06e2bf0976]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 18:01:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd (non-flash)
Nov 13 18:01:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38a136d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc87e18-ead9-4777-9750-02b8d6c10fd3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dede3c38-9992-4cc8-8fcd-591599e40179]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4f853a-9150-422f-b309-5e8e510a38f2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c954e33-7e57-4527-b60d-924417dfed46]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26562666633396662', '/dev/disk/by-id/scsi-1SCST_BIOa599348b-ebff39fb1c5e1bd2', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a599348b') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[88358948-faa8-40b5-adca-fc14bf8bd8e1]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf96dc9-4b84-41fd-858b-5e4d591778f2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ab0c8d-1591-452d-9526-b85307692a9b]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260]
Nov 13 18:01:37 user nova-compute[75100]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd, portal: 172.16.0.220,3260] successful.
Nov 13 18:01:37 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4106100-9141-4e17-82b8-3445f97da7cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09acf05-24b5-49c4-855a-89a94fdc8a87]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] <== disconnect_volume: return (325ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:01:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Deleting instance files /opt/stack/data/nova/instances/ee62ff36-6731-4a1c-9536-00b8e55a63e8_del
Nov 13 18:01:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Deletion of /opt/stack/data/nova/instances/ee62ff36-6731-4a1c-9536-00b8e55a63e8_del complete
Nov 13 18:01:37 user nova-compute[75100]: INFO nova.compute.manager [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 13 18:01:37 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:37 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:01:37 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Took 0.46 seconds to deallocate network for instance.
Nov 13 18:01:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-f7345b1d-71c6-4df8-9c8b-52e3152fc252 req-c87ab8e4-8ebf-4e8b-968e-bee828c61079 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-vif-deleted-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:01:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-234530ab-d864-4027-b38c-54f5b37a567b req-6a52a4c4-59c6-46fd-8e35-99b33a430bf8 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received event network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:01:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-234530ab-d864-4027-b38c-54f5b37a567b req-6a52a4c4-59c6-46fd-8e35-99b33a430bf8 service nova] Acquiring lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:01:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-234530ab-d864-4027-b38c-54f5b37a567b req-6a52a4c4-59c6-46fd-8e35-99b33a430bf8 service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:01:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-234530ab-d864-4027-b38c-54f5b37a567b req-6a52a4c4-59c6-46fd-8e35-99b33a430bf8 service nova] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:01:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-234530ab-d864-4027-b38c-54f5b37a567b req-6a52a4c4-59c6-46fd-8e35-99b33a430bf8 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] No waiting events found dispatching network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:01:38 user nova-compute[75100]: WARNING nova.compute.manager [req-234530ab-d864-4027-b38c-54f5b37a567b req-6a52a4c4-59c6-46fd-8e35-99b33a430bf8 service nova] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Received unexpected event network-vif-plugged-b49b04b3-fb0d-4572-a83d-a7a023e0f158 for instance with vm_state active and task_state deleting.
Nov 13 18:01:38 user nova-compute[75100]: INFO nova.compute.manager [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Took 0.71 seconds to detach 1 volumes for instance.
Nov 13 18:01:38 user nova-compute[75100]: DEBUG nova.compute.manager [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] [instance: ee62ff36-6731-4a1c-9536-00b8e55a63e8] Deleting volume: b4106100-9141-4e17-82b8-3445f97da7cd {{(pid=75100) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 18:01:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:01:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:01:38 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:01:38 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:01:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:01:38 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Deleted allocations for instance ee62ff36-6731-4a1c-9536-00b8e55a63e8
Nov 13 18:01:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-6db0fb43-d20e-4a06-a912-98054a215183 tempest-TestShelveInstance-747882360 tempest-TestShelveInstance-747882360-project-member] Lock "ee62ff36-6731-4a1c-9536-00b8e55a63e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.745s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:01:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:01:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:01:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:01:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:01:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:01:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:49 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:01:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:01:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:01:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:01:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:01:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:01:51 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:01:51 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:01:51 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:01:51 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=9098MB free_disk=25.03546142578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:01:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:01:51 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:01:51 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:01:51 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:01:51 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:01:51 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:01:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:01:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:01:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:01:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:01:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:01:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:01:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:01:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:01:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:01:53 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 18:01:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:01:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:01:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:01:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:01:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:01:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:01:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:01:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:01:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:02:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:02:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:02 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:02:04 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:02:04 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:02:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:02:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:02:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:16 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:02:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:02:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:02:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:29 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:02:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:51 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:02:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:02:52 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:02:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=9271MB free_disk=25.033668518066406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:02:52 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:02:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:02:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:02:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:02:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:02:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 18:02:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:02:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:02:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:02:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:02:57 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:03:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:03:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:03:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:03:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:03:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:03:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:03:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:03:06 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:03:06 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:03:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:03:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:03:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:03:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:03:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:03:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:13 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:15 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:18 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:20 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Starting instance... {{(pid=75100) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75100) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 18:03:28 user nova-compute[75100]: INFO nova.compute.claims [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Claim successful on node user
Nov 13 18:03:28 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Start building networks asynchronously for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Allocating IP information in the background. {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG nova.network.neutron [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] allocate_for_instance() {{(pid=75100) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 18:03:28 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 18:03:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Start building block device mappings for instance. {{(pid=75100) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 18:03:28 user nova-compute[75100]: DEBUG nova.policy [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f392a16f9c1b49f1885a2a5fa2647f98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbe120ff21a4507b2be087d93c288c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75100) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG nova.compute.manager [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Start spawning the instance on the hypervisor. {{(pid=75100) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Creating instance directory {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 18:03:29 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Creating image(s)
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "/opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "/opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk 1073741824 {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9,backing_fmt=raw /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk 1073741824" returned: 0 in 0.062s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "dcd5dd4da951cedb21ed0abb849f260b915b72f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG nova.network.neutron [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Successfully created port: a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dcd5dd4da951cedb21ed0abb849f260b915b72f9 --force-share --output=json" returned: 0 in 0.220s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk. size=1073741824 {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG nova.virt.disk.api [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Cannot resize image /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk to a smaller size. {{(pid=75100) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Created local disks {{(pid=75100) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Ensure instance console log exists: /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/console.log {{(pid=75100) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:03:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:03:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Successfully updated port: a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 18:03:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:03:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquired lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:03:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Building network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 18:03:30 user nova-compute[75100]: DEBUG nova.network.neutron [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Instance cache missing network info. {{(pid=75100) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 18:03:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-0d270b7c-d51d-4409-8fb9-50122493ab5f req-2f3158c3-5ac8-4fde-b11b-5b92600385dd service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Received event network-changed-a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:03:30 user nova-compute[75100]: DEBUG nova.compute.manager [req-0d270b7c-d51d-4409-8fb9-50122493ab5f req-2f3158c3-5ac8-4fde-b11b-5b92600385dd service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Refreshing instance network info cache due to event network-changed-a0736df0-5f6b-418a-871c-8ac3b0b9719b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:03:30 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0d270b7c-d51d-4409-8fb9-50122493ab5f req-2f3158c3-5ac8-4fde-b11b-5b92600385dd service nova] Acquiring lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.network.neutron [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating instance_info_cache with network_info: [{"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Releasing lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.compute.manager [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Instance network_info: |[{"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75100) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0d270b7c-d51d-4409-8fb9-50122493ab5f req-2f3158c3-5ac8-4fde-b11b-5b92600385dd service nova] Acquired lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-0d270b7c-d51d-4409-8fb9-50122493ab5f req-2f3158c3-5ac8-4fde-b11b-5b92600385dd service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Refreshing network info cache for port a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Start _get_guest_xml network_info=[{"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'encryption_format': None, 'size': 0, 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '40ac832f-026d-4a87-87c5-ec47fa8f4825'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 18:03:31 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:03:31 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] CPU controller missing on host. {{(pid=75100) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.host [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] CPU controller found on host. {{(pid=75100) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75100) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T17:15:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T17:15:40Z,direct_url=<?>,disk_format='qcow2',id=40ac832f-026d-4a87-87c5-ec47fa8f4825,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='458e9f65fc7f403d89d88b277a17b562',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T17:15:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Flavor limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Image limits 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Flavor pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Image pref 0:0:0 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75100) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Got 1 possible topologies {{(pid=75100) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.hardware [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75100) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-451288130',display_name='tempest-SnapshotDataIntegrityTests-server-451288130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-451288130',id=53,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOf7K7gLHorVcw5GiOJJrlWwtCFWHF3op6oARF6Zt6atOLh18AMiHA62Y6hVszsIjYvHP7DoyrCH24/T2ORpri9nUQqkz/QDh8yHUfEEWS/9dmpSqLLXrQYkkkXNMY3EuQ==',key_name='tempest-keypair-1051146085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbbe120ff21a4507b2be087d93c288c5',ramdisk_id='',reservation_id='r-bvc39jh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1846863586',owner_user_name='tempest-SnapshotDataIntegrityTests-1846863586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f392a16f9c1b49f1885a2a5fa2647f98',uuid=1e93d1e4-1f86-4ef2-9769-adfca6f54c74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75100) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Converting VIF {"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:63:48,bridge_name='br-int',has_traffic_filtering=True,id=a0736df0-5f6b-418a-871c-8ac3b0b9719b,network=Network(51bd3e79-ed64-4b56-92bb-db2760b37599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0736df0-5f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.objects.instance [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] End _get_guest_xml xml=<domain type="kvm">
Nov 13 18:03:31 user nova-compute[75100]:   <uuid>1e93d1e4-1f86-4ef2-9769-adfca6f54c74</uuid>
Nov 13 18:03:31 user nova-compute[75100]:   <name>instance-00000035</name>
Nov 13 18:03:31 user nova-compute[75100]:   <memory>524288</memory>
Nov 13 18:03:31 user nova-compute[75100]:   <vcpu>1</vcpu>
Nov 13 18:03:31 user nova-compute[75100]:   <metadata>
Nov 13 18:03:31 user nova-compute[75100]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 18:03:31 user nova-compute[75100]:       <nova:package version="0.0.0"/>
Nov 13 18:03:31 user nova-compute[75100]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-451288130</nova:name>
Nov 13 18:03:31 user nova-compute[75100]:       <nova:creationTime>2023-11-13 18:03:31</nova:creationTime>
Nov 13 18:03:31 user nova-compute[75100]:       <nova:flavor name="m1.tiny">
Nov 13 18:03:31 user nova-compute[75100]:         <nova:memory>512</nova:memory>
Nov 13 18:03:31 user nova-compute[75100]:         <nova:disk>1</nova:disk>
Nov 13 18:03:31 user nova-compute[75100]:         <nova:swap>0</nova:swap>
Nov 13 18:03:31 user nova-compute[75100]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 18:03:31 user nova-compute[75100]:         <nova:vcpus>1</nova:vcpus>
Nov 13 18:03:31 user nova-compute[75100]:       </nova:flavor>
Nov 13 18:03:31 user nova-compute[75100]:       <nova:owner>
Nov 13 18:03:31 user nova-compute[75100]:         <nova:user uuid="f392a16f9c1b49f1885a2a5fa2647f98">tempest-SnapshotDataIntegrityTests-1846863586-project-member</nova:user>
Nov 13 18:03:31 user nova-compute[75100]:         <nova:project uuid="fbbe120ff21a4507b2be087d93c288c5">tempest-SnapshotDataIntegrityTests-1846863586</nova:project>
Nov 13 18:03:31 user nova-compute[75100]:       </nova:owner>
Nov 13 18:03:31 user nova-compute[75100]:       <nova:root type="image" uuid="40ac832f-026d-4a87-87c5-ec47fa8f4825"/>
Nov 13 18:03:31 user nova-compute[75100]:       <nova:ports>
Nov 13 18:03:31 user nova-compute[75100]:         <nova:port uuid="a0736df0-5f6b-418a-871c-8ac3b0b9719b">
Nov 13 18:03:31 user nova-compute[75100]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 18:03:31 user nova-compute[75100]:         </nova:port>
Nov 13 18:03:31 user nova-compute[75100]:       </nova:ports>
Nov 13 18:03:31 user nova-compute[75100]:     </nova:instance>
Nov 13 18:03:31 user nova-compute[75100]:   </metadata>
Nov 13 18:03:31 user nova-compute[75100]:   <sysinfo type="smbios">
Nov 13 18:03:31 user nova-compute[75100]:     <system>
Nov 13 18:03:31 user nova-compute[75100]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 18:03:31 user nova-compute[75100]:       <entry name="product">OpenStack Nova</entry>
Nov 13 18:03:31 user nova-compute[75100]:       <entry name="version">0.0.0</entry>
Nov 13 18:03:31 user nova-compute[75100]:       <entry name="serial">1e93d1e4-1f86-4ef2-9769-adfca6f54c74</entry>
Nov 13 18:03:31 user nova-compute[75100]:       <entry name="uuid">1e93d1e4-1f86-4ef2-9769-adfca6f54c74</entry>
Nov 13 18:03:31 user nova-compute[75100]:       <entry name="family">Virtual Machine</entry>
Nov 13 18:03:31 user nova-compute[75100]:     </system>
Nov 13 18:03:31 user nova-compute[75100]:   </sysinfo>
Nov 13 18:03:31 user nova-compute[75100]:   <os>
Nov 13 18:03:31 user nova-compute[75100]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 18:03:31 user nova-compute[75100]:     <boot dev="hd"/>
Nov 13 18:03:31 user nova-compute[75100]:     <smbios mode="sysinfo"/>
Nov 13 18:03:31 user nova-compute[75100]:   </os>
Nov 13 18:03:31 user nova-compute[75100]:   <features>
Nov 13 18:03:31 user nova-compute[75100]:     <acpi/>
Nov 13 18:03:31 user nova-compute[75100]:     <apic/>
Nov 13 18:03:31 user nova-compute[75100]:     <vmcoreinfo/>
Nov 13 18:03:31 user nova-compute[75100]:   </features>
Nov 13 18:03:31 user nova-compute[75100]:   <clock offset="utc">
Nov 13 18:03:31 user nova-compute[75100]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 18:03:31 user nova-compute[75100]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 18:03:31 user nova-compute[75100]:     <timer name="hpet" present="no"/>
Nov 13 18:03:31 user nova-compute[75100]:   </clock>
Nov 13 18:03:31 user nova-compute[75100]:   <cpu mode="custom" match="exact">
Nov 13 18:03:31 user nova-compute[75100]:     <model>Nehalem</model>
Nov 13 18:03:31 user nova-compute[75100]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 18:03:31 user nova-compute[75100]:   </cpu>
Nov 13 18:03:31 user nova-compute[75100]:   <devices>
Nov 13 18:03:31 user nova-compute[75100]:     <disk type="file" device="disk">
Nov 13 18:03:31 user nova-compute[75100]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 18:03:31 user nova-compute[75100]:       <source file="/opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk"/>
Nov 13 18:03:31 user nova-compute[75100]:       <target dev="vda" bus="virtio"/>
Nov 13 18:03:31 user nova-compute[75100]:     </disk>
Nov 13 18:03:31 user nova-compute[75100]:     <interface type="ethernet">
Nov 13 18:03:31 user nova-compute[75100]:       <mac address="fa:16:3e:17:63:48"/>
Nov 13 18:03:31 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 18:03:31 user nova-compute[75100]:       <mtu size="1442"/>
Nov 13 18:03:31 user nova-compute[75100]:       <target dev="tapa0736df0-5f"/>
Nov 13 18:03:31 user nova-compute[75100]:     </interface>
Nov 13 18:03:31 user nova-compute[75100]:     <serial type="pty">
Nov 13 18:03:31 user nova-compute[75100]:       <log file="/opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/console.log" append="off"/>
Nov 13 18:03:31 user nova-compute[75100]:     </serial>
Nov 13 18:03:31 user nova-compute[75100]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 18:03:31 user nova-compute[75100]:     <video>
Nov 13 18:03:31 user nova-compute[75100]:       <model type="virtio"/>
Nov 13 18:03:31 user nova-compute[75100]:     </video>
Nov 13 18:03:31 user nova-compute[75100]:     <rng model="virtio">
Nov 13 18:03:31 user nova-compute[75100]:       <backend model="random">/dev/urandom</backend>
Nov 13 18:03:31 user nova-compute[75100]:     </rng>
Nov 13 18:03:31 user nova-compute[75100]:     <controller type="usb" index="0" model="none"/>
Nov 13 18:03:31 user nova-compute[75100]:     <memballoon model="virtio">
Nov 13 18:03:31 user nova-compute[75100]:       <stats period="10"/>
Nov 13 18:03:31 user nova-compute[75100]:     </memballoon>
Nov 13 18:03:31 user nova-compute[75100]:   </devices>
Nov 13 18:03:31 user nova-compute[75100]: </domain>
Nov 13 18:03:31 user nova-compute[75100]:  {{(pid=75100) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-451288130',display_name='tempest-SnapshotDataIntegrityTests-server-451288130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-451288130',id=53,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOf7K7gLHorVcw5GiOJJrlWwtCFWHF3op6oARF6Zt6atOLh18AMiHA62Y6hVszsIjYvHP7DoyrCH24/T2ORpri9nUQqkz/QDh8yHUfEEWS/9dmpSqLLXrQYkkkXNMY3EuQ==',key_name='tempest-keypair-1051146085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbbe120ff21a4507b2be087d93c288c5',ramdisk_id='',reservation_id='r-bvc39jh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1846863586',owner_user_name='tempest-SnapshotDataIntegrityTests-1846863586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T18:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f392a16f9c1b49f1885a2a5fa2647f98',uuid=1e93d1e4-1f86-4ef2-9769-adfca6f54c74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Converting VIF {"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:63:48,bridge_name='br-int',has_traffic_filtering=True,id=a0736df0-5f6b-418a-871c-8ac3b0b9719b,network=Network(51bd3e79-ed64-4b56-92bb-db2760b37599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0736df0-5f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG os_vif [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:63:48,bridge_name='br-int',has_traffic_filtering=True,id=a0736df0-5f6b-418a-871c-8ac3b0b9719b,network=Network(51bd3e79-ed64-4b56-92bb-db2760b37599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0736df0-5f') {{(pid=75100) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '422fa207-993c-584b-98d6-21b63b4cfdea', '_type': 'linux-noop'}}, row=False) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0736df0-5f, may_exist=True, interface_attrs={}) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0736df0-5f, col_values=(('qos', UUID('3ded5fde-2b26-427a-9862-d10358adb77b')),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0736df0-5f, col_values=(('external_ids', {'iface-id': 'a0736df0-5f6b-418a-871c-8ac3b0b9719b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:63:48', 'vm-uuid': '1e93d1e4-1f86-4ef2-9769-adfca6f54c74'}),), if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:31 user nova-compute[75100]: INFO os_vif [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:63:48,bridge_name='br-int',has_traffic_filtering=True,id=a0736df0-5f6b-418a-871c-8ac3b0b9719b,network=Network(51bd3e79-ed64-4b56-92bb-db2760b37599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0736df0-5f')
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No VIF found with MAC fa:16:3e:17:63:48, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-0d270b7c-d51d-4409-8fb9-50122493ab5f req-2f3158c3-5ac8-4fde-b11b-5b92600385dd service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updated VIF entry in instance network info cache for port a0736df0-5f6b-418a-871c-8ac3b0b9719b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG nova.network.neutron [req-0d270b7c-d51d-4409-8fb9-50122493ab5f req-2f3158c3-5ac8-4fde-b11b-5b92600385dd service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating instance_info_cache with network_info: [{"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:03:31 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-0d270b7c-d51d-4409-8fb9-50122493ab5f req-2f3158c3-5ac8-4fde-b11b-5b92600385dd service nova] Releasing lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:03:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-9591aac5-d6aa-4727-a81e-49377f1b8db6 req-808e9b42-2dbc-4821-a9f7-c0595663c210 service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Received event network-vif-plugged-a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:03:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9591aac5-d6aa-4727-a81e-49377f1b8db6 req-808e9b42-2dbc-4821-a9f7-c0595663c210 service nova] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:03:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9591aac5-d6aa-4727-a81e-49377f1b8db6 req-808e9b42-2dbc-4821-a9f7-c0595663c210 service nova] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:03:33 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-9591aac5-d6aa-4727-a81e-49377f1b8db6 req-808e9b42-2dbc-4821-a9f7-c0595663c210 service nova] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:03:33 user nova-compute[75100]: DEBUG nova.compute.manager [req-9591aac5-d6aa-4727-a81e-49377f1b8db6 req-808e9b42-2dbc-4821-a9f7-c0595663c210 service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] No waiting events found dispatching network-vif-plugged-a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:03:33 user nova-compute[75100]: WARNING nova.compute.manager [req-9591aac5-d6aa-4727-a81e-49377f1b8db6 req-808e9b42-2dbc-4821-a9f7-c0595663c210 service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Received unexpected event network-vif-plugged-a0736df0-5f6b-418a-871c-8ac3b0b9719b for instance with vm_state building and task_state spawning.
Nov 13 18:03:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Instance event wait completed in 0 seconds for  {{(pid=75100) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Guest created on hypervisor {{(pid=75100) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 18:03:35 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Instance spawned successfully.
Nov 13 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Found default for hw_cdrom_bus of ide {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Found default for hw_disk_bus of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Found default for hw_input_bus of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Found default for hw_pointer_model of None {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Found default for hw_video_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Found default for hw_vif_model of virtio {{(pid=75100) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-89b101d5-8103-4a1b-8efa-d73725c84e55 req-649284bf-fdcd-4aea-9993-62f185ad725d service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Received event network-vif-plugged-a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-89b101d5-8103-4a1b-8efa-d73725c84e55 req-649284bf-fdcd-4aea-9993-62f185ad725d service nova] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-89b101d5-8103-4a1b-8efa-d73725c84e55 req-649284bf-fdcd-4aea-9993-62f185ad725d service nova] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-89b101d5-8103-4a1b-8efa-d73725c84e55 req-649284bf-fdcd-4aea-9993-62f185ad725d service nova] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:03:35 user nova-compute[75100]: DEBUG nova.compute.manager [req-89b101d5-8103-4a1b-8efa-d73725c84e55 req-649284bf-fdcd-4aea-9993-62f185ad725d service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] No waiting events found dispatching network-vif-plugged-a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:03:35 user nova-compute[75100]: WARNING nova.compute.manager [req-89b101d5-8103-4a1b-8efa-d73725c84e55 req-649284bf-fdcd-4aea-9993-62f185ad725d service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Received unexpected event network-vif-plugged-a0736df0-5f6b-418a-871c-8ac3b0b9719b for instance with vm_state building and task_state spawning.
Nov 13 18:03:35 user nova-compute[75100]: INFO nova.compute.manager [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Took 6.20 seconds to spawn the instance on the hypervisor.
Nov 13 18:03:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Checking state {{(pid=75100) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 18:03:35 user nova-compute[75100]: INFO nova.compute.manager [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Took 6.85 seconds to build instance.
Nov 13 18:03:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-89c4523d-1a30-4da0-8a8e-131cfa683a4f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.963s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:03:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:48 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:03:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:03:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:03:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:03:53 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:03:53 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:03:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:03:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:03:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:03:53 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:03:54 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:03:54 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:03:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=24.991439819335938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:03:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:03:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:03:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:03:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:03:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:03:54 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:03:54 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:03:54 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:03:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:03:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:03:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:03:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:03:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:03:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:03:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:03:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:03:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating instance_info_cache with network_info: [{"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:03:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:03:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:03:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:03:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:03:58 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:03:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:04:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:04:03 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:04 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:04:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:08 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:04:08 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:04:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:04:21 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:04:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:04:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:04:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:04:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:04:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:04:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:04:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:04:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:04:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:04:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:04:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:04:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:04:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:04:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:04:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:04:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:04:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:04:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:04:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:04:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:04:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:04:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:04:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:04:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:04:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:04:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:04:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:04:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:04:54 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:04:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating instance_info_cache with network_info: [{"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:04:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:04:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:04:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:04:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:04:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:04:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:04:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:04:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:04:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:04:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:04:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:04:56 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:04:56 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:04:56 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=24.989070892333984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:04:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:04:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:04:56 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:04:56 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:04:56 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:04:56 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:04:56 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:04:56 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:04:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:04:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:04:57 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:04:57 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:04:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:05:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:05:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:05:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:05:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:05:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:05:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:05:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:05:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:05:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:05:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:05:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:06 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:05:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:05:10 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:05:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:05:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-11966b6a-601f-4f29-a28d-e7bb6aa12338 req-ac747a87-3555-47ff-93ec-184297a1cff2 service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Received event network-changed-a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:05:19 user nova-compute[75100]: DEBUG nova.compute.manager [req-11966b6a-601f-4f29-a28d-e7bb6aa12338 req-ac747a87-3555-47ff-93ec-184297a1cff2 service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Refreshing instance network info cache due to event network-changed-a0736df0-5f6b-418a-871c-8ac3b0b9719b. {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 18:05:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-11966b6a-601f-4f29-a28d-e7bb6aa12338 req-ac747a87-3555-47ff-93ec-184297a1cff2 service nova] Acquiring lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:05:19 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-11966b6a-601f-4f29-a28d-e7bb6aa12338 req-ac747a87-3555-47ff-93ec-184297a1cff2 service nova] Acquired lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:05:19 user nova-compute[75100]: DEBUG nova.network.neutron [req-11966b6a-601f-4f29-a28d-e7bb6aa12338 req-ac747a87-3555-47ff-93ec-184297a1cff2 service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Refreshing network info cache for port a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 18:05:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-11966b6a-601f-4f29-a28d-e7bb6aa12338 req-ac747a87-3555-47ff-93ec-184297a1cff2 service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updated VIF entry in instance network info cache for port a0736df0-5f6b-418a-871c-8ac3b0b9719b. {{(pid=75100) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 18:05:20 user nova-compute[75100]: DEBUG nova.network.neutron [req-11966b6a-601f-4f29-a28d-e7bb6aa12338 req-ac747a87-3555-47ff-93ec-184297a1cff2 service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating instance_info_cache with network_info: [{"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:05:20 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-11966b6a-601f-4f29-a28d-e7bb6aa12338 req-ac747a87-3555-47ff-93ec-184297a1cff2 service nova] Releasing lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:05:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:05:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:05:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:05:22 user nova-compute[75100]: DEBUG nova.objects.instance [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'flavor' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:05:22 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:05:23 user nova-compute[75100]: INFO nova.compute.manager [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attaching volume 2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c to /dev/vdb
Nov 13 18:05:23 user nova-compute[75100]: DEBUG os_brick.utils [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92358bc-1c0d-4daf-8e72-b1435b02c133]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9244b98-7e50-479f-a98b-40a4d4cb51af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfd7c10-93bf-4ed9-a578-c8401ea0a1b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc0c995-a6eb-40f5-9aba-5def822f2571]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:05:23 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:05:23 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77d469f-adcd-4c93-bf93-eb8819309177]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG os_brick.utils [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating existing volume attachment record: deb5dd61-a9a5-480c-b361-40f1e7ebeac3 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:05:23 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyjucbNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:05:27 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:05:27 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:05:27 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fe5549-78ac-46c8-943a-9ec5b560fc92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:05:27 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8b06b1-b8a5-404c-b058-4688428ab997]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c] added
Nov 13 18:05:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffb52b0-34c8-42d5-b071-1dbcdd36f271]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9321f86a-ccb8-42a9-8d34-280635ab5094]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyjucbNp {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyjucbNp" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e5c882-b300-447b-bf6d-af697164a066]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vyjucbNp'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d689efee-b8d7-48d8-8924-86772107e0d9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa2882e-c7f5-4361-a4dc-4a821946bf10]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:05:27 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:05:27 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:05:27 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 18:05:27 user nova-compute[75100]: 
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[73094ded-4d4f-47c9-8454-0f2d54abe868]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c, portal: 172.16.0.220,3260]
Nov 13 18:05:27 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c, portal: 172.16.0.220,3260] successful.
Nov 13 18:05:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b658e5-3e89-4b61-a1ac-74b9ea836f81]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cc9fc6-66c0-4ef0-9952-640964b056e6]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c (non-flash)
Nov 13 18:05:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c (non-flash)
Nov 13 18:05:27 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0ac95e-95ab-4e31-b454-b5264846ea5f]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:05:27 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyjucbNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:05:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:05:28 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23563636539333735', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:05:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563636539333735', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:05:28 user nova-compute[75100]: DEBUG nova.objects.instance [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'flavor' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:05:28 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:05:28 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:05:28 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 18:05:28 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:05:28 user nova-compute[75100]:   <serial>2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c</serial>
Nov 13 18:05:28 user nova-compute[75100]: </disk>
Nov 13 18:05:28 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:05:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:05:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:05:29 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No VIF found with MAC fa:16:3e:17:63:48, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:05:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-84136b7c-f8d9-4cb9-b016-00febfb4052e tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.216s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:05:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:05:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:05:36 user nova-compute[75100]: INFO nova.compute.manager [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Detaching volume 2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c
Nov 13 18:05:36 user nova-compute[75100]: INFO nova.virt.block_device [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attempting to driver detach volume 2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c from mountpoint /dev/vdb
Nov 13 18:05:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Attempting to detach device vdb from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:05:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:05:36 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:05:36 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 18:05:36 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:05:36 user nova-compute[75100]:   <serial>2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c</serial>
Nov 13 18:05:36 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:05:36 user nova-compute[75100]: </disk>
Nov 13 18:05:36 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:05:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Successfully detached device vdb from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the persistent domain config.
Nov 13 18:05:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:05:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:05:36 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:05:36 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 18:05:36 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:05:36 user nova-compute[75100]:   <serial>2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c</serial>
Nov 13 18:05:36 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:05:36 user nova-compute[75100]: </disk>
Nov 13 18:05:36 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:05:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:05:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:05:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:53 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:53 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:05:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:05:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:05:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:05:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:05:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:05:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:05:54 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating instance_info_cache with network_info: [{"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:05:55 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:05:55 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=24.987823486328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:05:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing inventories for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating ProviderTree inventory for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Updating inventory in ProviderTree for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing aggregate associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, aggregates: None {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Refreshing trait associations for resource provider d0cd9ee7-47c1-40a1-b685-446f6384b590, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_QXL {{(pid=75100) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:05:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:05:57 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 is timed out.
Nov 13 18:05:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Successfully detached device vdb from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the live domain config.
Nov 13 18:05:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyjucbNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:05:57 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d62cba-9caa-4e23-bded-14a1e878a41a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:05:57 user nova-compute[75100]: No targets found.
Nov 13 18:05:57 user nova-compute[75100]: iSNS:
Nov 13 18:05:57 user nova-compute[75100]: No targets found.
Nov 13 18:05:57 user nova-compute[75100]: STATIC:
Nov 13 18:05:57 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c
Nov 13 18:05:57 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:05:57 user nova-compute[75100]:                 Iface Name: default
Nov 13 18:05:57 user nova-compute[75100]: FIRMWARE:
Nov 13 18:05:57 user nova-compute[75100]: No targets found.
Nov 13 18:05:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:05:57 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:05:57 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c752228d-cdf9-4409-8a27-1b89ccaea949]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cae65d-7d20-4ede-a84e-2bb7394c4edb]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c (non-flash)
Nov 13 18:05:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c (non-flash)
Nov 13 18:05:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c219f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d306d80-61d0-4ff5-9558-bba19cf0f171]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ddd5bc-f520-489d-a7e8-b5a901d7c043]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8f90ec-856f-4a63-93ab-0d9cf58d6321]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84019a7-c13b-4be4-a7d7-cdf51a9d1530]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd75fd5-04c5-4fca-afc5-f07a0e410b98]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f099b44-66d9-4372-b601-64317cce5d3c]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c, portal: 172.16.0.220,3260]
Nov 13 18:05:57 user nova-compute[75100]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c, portal: 172.16.0.220,3260] successful.
Nov 13 18:05:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e5a6b7c-f2bf-4054-96ad-88a2ca55af7c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c79a11-cd7e-4359-9852-bef5d63fac7d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] <== disconnect_volume: return (296ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:05:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:05:58 user nova-compute[75100]: DEBUG nova.objects.instance [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'flavor' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:05:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-f115d276-98ea-4b51-a003-3cf4f3e0fe8c tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.605s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:05:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:05:59 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:06:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:06:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:06:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:06:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:06:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:06:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:06:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:06:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:06:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:06:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:06:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:06:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:06:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:06:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:06:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:06:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:06:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:06:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:06:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:06:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:06:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:20 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:06:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 18:06:20 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] There are 0 instances to clean {{(pid=75100) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 18:06:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:06:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:06:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:06:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:06:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:22 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:06:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75100) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'flavor' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:06:28 user nova-compute[75100]: INFO nova.compute.manager [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attaching volume 430d4aa8-2721-4fca-962a-7e1ab84aef85 to /dev/vdb
Nov 13 18:06:28 user nova-compute[75100]: DEBUG os_brick.utils [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be59531-adb6-4ace-ad5f-7214aeece0a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13c03b8-8b32-45c7-b5af-d2103e426b9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:28 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8902bda0-aad5-414f-a206-0f94545a4715]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[74785ae2-1f3f-45e1-8b19-c8de7fb50b52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:06:29 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:06:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f2bdef-0710-44e4-9eb9-825424be38ca]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG os_brick.utils [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:06:29 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating existing volume attachment record: 50057fb9-cbeb-4e89-b724-cc14174a204d {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:06:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEIrSCxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:06:32 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:06:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:06:32 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:06:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:06:32 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5525e05f-51f9-4fd6-ac67-e4865e0aa701]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:06:32 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[68eafd9c-2866-4577-8003-66374850158d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85] added
Nov 13 18:06:32 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[20571d76-ae69-474b-8c37-b6998512038c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a7e14d-e999-4f41-ba41-55875b9a4b6f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEIrSCxM {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sEIrSCxM" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8638f5-e729-4b94-9842-eed74ada08e4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sEIrSCxM'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:06:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ebc690-edad-4764-bac7-01eec114ae33]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b5b2c3-eb8f-42b5-a6c2-9b10d1396b28]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:06:33 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:06:33 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:06:33 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 18:06:33 user nova-compute[75100]: 
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd921a65-f86d-4c75-a2b0-ff250172ffcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85, portal: 172.16.0.220,3260]
Nov 13 18:06:33 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85, portal: 172.16.0.220,3260] successful.
Nov 13 18:06:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cbf9a9-4440-4fae-abc2-aa3d06f295db]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4d9ec9-6203-4425-9376-0b66f85c4192]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 (non-flash)
Nov 13 18:06:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 (non-flash)
Nov 13 18:06:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe53e06-6e85-44b5-878e-f735e1fb9074]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEIrSCxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:06:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:06:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26466623333393561', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:06:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466623333393561', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:06:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'flavor' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:06:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:06:34 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:06:34 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 18:06:34 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:06:34 user nova-compute[75100]:   <serial>430d4aa8-2721-4fca-962a-7e1ab84aef85</serial>
Nov 13 18:06:34 user nova-compute[75100]: </disk>
Nov 13 18:06:34 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:06:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:06:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:06:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No VIF found with MAC fa:16:3e:17:63:48, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:06:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ca3d0f33-5803-426b-8152-35f3ddfb299d tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.848s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:06:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:06:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:06:36 user nova-compute[75100]: INFO nova.compute.manager [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Detaching volume 430d4aa8-2721-4fca-962a-7e1ab84aef85
Nov 13 18:06:36 user nova-compute[75100]: INFO nova.virt.block_device [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attempting to driver detach volume 430d4aa8-2721-4fca-962a-7e1ab84aef85 from mountpoint /dev/vdb
Nov 13 18:06:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Attempting to detach device vdb from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:06:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:06:36 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:06:36 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 18:06:36 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:06:36 user nova-compute[75100]:   <serial>430d4aa8-2721-4fca-962a-7e1ab84aef85</serial>
Nov 13 18:06:36 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:06:36 user nova-compute[75100]: </disk>
Nov 13 18:06:36 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:06:36 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Successfully detached device vdb from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the persistent domain config.
Nov 13 18:06:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:06:36 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:06:36 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:06:36 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 18:06:36 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:06:36 user nova-compute[75100]:   <serial>430d4aa8-2721-4fca-962a-7e1ab84aef85</serial>
Nov 13 18:06:36 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:06:36 user nova-compute[75100]: </disk>
Nov 13 18:06:36 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:06:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:06:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:06:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:06:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:06:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:06:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:06:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:06:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:06:54 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:06:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating instance_info_cache with network_info: [{"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:06:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:06:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:06:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:06:56 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:06:56 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:06:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:56 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:57 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:06:57 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:06:57 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=24.986892700195312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:06:57 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 is timed out.
Nov 13 18:06:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Successfully detached device vdb from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the live domain config.
Nov 13 18:06:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sEIrSCxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:06:57 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef998d5a-679a-4334-9670-4fb541de88f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:06:57 user nova-compute[75100]: No targets found.
Nov 13 18:06:57 user nova-compute[75100]: iSNS:
Nov 13 18:06:57 user nova-compute[75100]: No targets found.
Nov 13 18:06:57 user nova-compute[75100]: STATIC:
Nov 13 18:06:57 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85
Nov 13 18:06:57 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:06:57 user nova-compute[75100]:                 Iface Name: default
Nov 13 18:06:57 user nova-compute[75100]: FIRMWARE:
Nov 13 18:06:57 user nova-compute[75100]: No targets found.
Nov 13 18:06:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:06:57 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:06:57 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b85d94-d9f7-497f-a940-cb24eb72c2e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18625e5-2831-4f22-b0de-820a639931bd]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 (non-flash)
Nov 13 18:06:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 (non-flash)
Nov 13 18:06:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda5c21ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[882a9b4d-5abc-4150-ae29-a83bb706cc84]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b35cc0-012f-4ee4-ab27-42a6e3f7c6d7]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c687b4-4431-49db-9831-3a7aa1521643]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3ed5f0-6459-4d95-b11f-e01f54e45a66]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fcc3e1-60bd-44af-8e94-b7211a99eeb5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06d6c07-b625-494d-b26a-468f2f356ac1]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85, portal: 172.16.0.220,3260]
Nov 13 18:06:57 user nova-compute[75100]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85, portal: 172.16.0.220,3260] successful.
Nov 13 18:06:57 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:430d4aa8-2721-4fca-962a-7e1ab84aef85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e63c053-6288-4367-9502-93fd8144aa99]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] <== disconnect_volume: return (306ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:06:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:06:58 user nova-compute[75100]: DEBUG nova.objects.instance [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'flavor' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:06:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-b2a13243-ca7a-470f-b43b-3642af15f329 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.663s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:07:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:07:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:07:01 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:07:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:07:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:07:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:07:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:07:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:07:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:07:02 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:07:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:07:07 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:07:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:07:12 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:07:12 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:07:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:07:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:07:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:07:28 user nova-compute[75100]: DEBUG nova.objects.instance [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'flavor' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:07:28 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:07:29 user nova-compute[75100]: INFO nova.compute.manager [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attaching volume 9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 to /dev/vdb
Nov 13 18:07:29 user nova-compute[75100]: DEBUG os_brick.utils [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8d433d-f556-4e33-b02d-42399e9ccd43]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b248117-e8b1-4c54-8cda-734a8ad2778e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d11a0bf-8459-4390-a959-46baddb96427]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f90d10-af40-4402-be57-05662041e3fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:07:29 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:07:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[91465e46-8d6c-4030-9474-62d211c5d576]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG os_brick.utils [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:07:29 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating existing volume attachment record: 0d44f649-07ee-493c-8d3a-d05d4f26e7a3 {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:07:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:07:32 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:07:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgvWjyth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:07:32 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:07:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:07:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:07:32 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:07:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:07:32 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:07:32 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:07:32 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a51433e-3bd1-4818-9dd8-426d24ed435a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:07:33 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[19044409-eba8-4ec0-b24b-13d9c27d68cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8] added
Nov 13 18:07:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b6b404-73e2-4318-85fa-fc60df116374]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3474dd44-d3aa-4835-b214-ec3ab4ecfcab]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GgvWjyth {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GgvWjyth" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ac56a3-3704-401c-8cdc-f5b8fd9d9d96]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GgvWjyth'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecc3a5e-793e-4209-a581-3a340831d89f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc429b0a-0235-498e-a652-12e6a5d9c4ba]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:07:33 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:07:33 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:07:33 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 18:07:33 user nova-compute[75100]: 
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[550bc905-bb35-4378-8a23-46d0e0aee828]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8, portal: 172.16.0.220,3260]
Nov 13 18:07:33 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8, portal: 172.16.0.220,3260] successful.
Nov 13 18:07:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccbf3b2-0e95-4980-ae3a-4553478bca2c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[9840c2ef-056c-4c38-842e-de71a1792b7e]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 (non-flash)
Nov 13 18:07:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 (non-flash)
Nov 13 18:07:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08f1c8d-dd2b-4eb1-b718-6bbdef019bd3]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgvWjyth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:07:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:07:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:07:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23635666238306530', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:07:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635666238306530', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:07:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'flavor' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:07:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:07:34 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:07:34 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 18:07:34 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:07:34 user nova-compute[75100]:   <serial>9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8</serial>
Nov 13 18:07:34 user nova-compute[75100]: </disk>
Nov 13 18:07:34 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:07:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:07:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:07:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No VIF found with MAC fa:16:3e:17:63:48, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:07:34 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-318f0584-9082-4784-bf61-ab978bb08c67 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.820s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:07:35 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:07:35 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Triggering sync for uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 18:07:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:07:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:07:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:07:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:07:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:07:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:07:37 user nova-compute[75100]: INFO nova.compute.manager [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Detaching volume 9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8
Nov 13 18:07:37 user nova-compute[75100]: INFO nova.virt.block_device [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attempting to driver detach volume 9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 from mountpoint /dev/vdb
Nov 13 18:07:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Attempting to detach device vdb from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:07:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:07:37 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:07:37 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 18:07:37 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:07:37 user nova-compute[75100]:   <serial>9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8</serial>
Nov 13 18:07:37 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:07:37 user nova-compute[75100]: </disk>
Nov 13 18:07:37 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:07:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Successfully detached device vdb from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the persistent domain config.
Nov 13 18:07:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:07:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:07:37 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:07:37 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 18:07:37 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:07:37 user nova-compute[75100]:   <serial>9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8</serial>
Nov 13 18:07:37 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:07:37 user nova-compute[75100]: </disk>
Nov 13 18:07:37 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:07:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:07:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:07:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:07:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:07:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:07:54 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:07:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:07:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:07:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:07:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:07:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:07:54 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:07:54 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating instance_info_cache with network_info: [{"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:07:54 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:07:54 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:07:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:07:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:07:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:07:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:07:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:07:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:07:57 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:07:57 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 is timed out.
Nov 13 18:07:57 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Successfully detached device vdb from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the live domain config.
Nov 13 18:07:57 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:07:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GgvWjyth', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:07:57 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:07:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:07:57 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:07:57 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc4a3f1-dee3-4bfb-beee-60c753153b0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:07:58 user nova-compute[75100]: No targets found.
Nov 13 18:07:58 user nova-compute[75100]: iSNS:
Nov 13 18:07:58 user nova-compute[75100]: No targets found.
Nov 13 18:07:58 user nova-compute[75100]: STATIC:
Nov 13 18:07:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8
Nov 13 18:07:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:07:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 18:07:58 user nova-compute[75100]: FIRMWARE:
Nov 13 18:07:58 user nova-compute[75100]: No targets found.
Nov 13 18:07:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:07:58 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:07:58 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6a7d8d-af97-4617-8ee7-5b74793ef21a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[719728b8-4014-4c1f-99f3-d610db6a883f]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 (non-flash)
Nov 13 18:07:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 (non-flash)
Nov 13 18:07:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38dd3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1e198b-4e32-47d6-ae8b-9c3d961d6e34]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[01249679-6cb2-4fac-bc0a-e428ff99cb02]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd47634f-2627-4b2d-a9ad-9822115e91d0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b11f55-21db-4391-8652-5ecb8eee29f2]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc09909c-1077-45d4-b653-e94736c143cc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecd0a19-1426-44d1-9e02-daca4dd0c8f7]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8, portal: 172.16.0.220,3260]
Nov 13 18:07:58 user nova-compute[75100]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8, portal: 172.16.0.220,3260] successful.
Nov 13 18:07:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9af3c5c2-52fc-4bdf-9ee2-dada37f03ab8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de0f7d6-3e6c-4725-878b-1b812440b940]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] <== disconnect_volume: return (285ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:07:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:07:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'flavor' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:07:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:07:59 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:07:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8992MB free_disk=24.985885620117188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:07:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:07:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:07:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-7b513b1f-5281-438b-a20d-14489b7a3779 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.879s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:07:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:07:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:07:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:07:59 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:07:59 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:07:59 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:07:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:08:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:08:02 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:08:02 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:08:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:08:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:08:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:08:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:08:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:08:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:08:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:08 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:08:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:08:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:08:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:08:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:08:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:25 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:08:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'flavor' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:08:29 user nova-compute[75100]: INFO nova.compute.manager [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attaching volume 453c79de-623a-4b75-a747-84ec156fc5d9 to /dev/vdb
Nov 13 18:08:29 user nova-compute[75100]: DEBUG os_brick.utils [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7113d9ef-fc67-458f-aa87-6cfc01968157]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6178a68e2092\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2cea09-54d6-4dab-b519-7f4ddcd2224c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d8f9b0-abdd-4857-ab1e-0f2ac2b76e07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17327d0-8b3a-4456-8e54-2de05cb45de9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Running cmd (subprocess): nvme version {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] 'nvme version' failed. Not Retrying. {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] nvme not present on system {{(pid=75100) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 18:08:29 user nova-compute[75100]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 18:08:29 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d081741-e424-48d2-95c6-8d38c97e3944]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75100) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.lightos [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] LIGHTOS: no hostnqn found. {{(pid=75100) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG os_brick.utils [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6178a68e2092', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:08:29 user nova-compute[75100]: DEBUG nova.virt.block_device [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating existing volume attachment record: 95d40d6f-4e5e-4cce-9fc5-49f10e2d398b {{(pid=75100) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 18:08:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Calling os-brick to attach iSCSI Volume {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCzTJldI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:08:33 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:08:33 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:08:33 user nova-compute[75100]: INFO os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[365726b4-d5d3-44b9-aa2c-384f1a89c8bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 18:08:33 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[add01956-8d81-4fd0-8c9d-9cbc9f82e4d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9] added
Nov 13 18:08:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[3734c4a6-8252-4ad4-bbee-63ff23e1db09]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa1d2a9-4776-4003-a49e-566ff69ebb86]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCzTJldI {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XCzTJldI" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a974e7d-d507-4777-a4f7-cfb3efc4c907]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XCzTJldI'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5bc6de-17dc-43e8-8f02-a2032f1670f2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8707e948-e2b9-4004-bda9-c97a4000b28e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:08:33 user nova-compute[75100]:  {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 18:08:33 user nova-compute[75100]:  {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:08:33 user nova-compute[75100]: WARNING os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 18:08:33 user nova-compute[75100]: 
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a4c526-5df4-407f-8dee-06ee3a63559e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9, portal: 172.16.0.220,3260]
Nov 13 18:08:33 user nova-compute[75100]: Login to [iface: default, target: iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9, portal: 172.16.0.220,3260] successful.
Nov 13 18:08:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8903f418-39f7-403f-9a35-e5c4ef119121]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b120f73-cc2f-4b45-9ade-91028382fd40]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 (non-flash)
Nov 13 18:08:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 (non-flash)
Nov 13 18:08:33 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Connected to 172.16.0.220:3260 {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75100) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75100) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f78012d-25d0-44f1-b10d-3f37af92e3c9]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75100) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 18:08:33 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCzTJldI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75100) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 18:08:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:08:34 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '26639636131383137', 'path': '/dev/sdb'} {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:08:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639636131383137', 'path': '/dev/sdb'} {{(pid=75100) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 18:08:34 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'flavor' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:08:34 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 18:08:34 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:08:34 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 18:08:34 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:08:34 user nova-compute[75100]:   <serial>453c79de-623a-4b75-a747-84ec156fc5d9</serial>
Nov 13 18:08:34 user nova-compute[75100]: </disk>
Nov 13 18:08:34 user nova-compute[75100]:  {{(pid=75100) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 18:08:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No BDM found with device name vda, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:08:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75100) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 18:08:35 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] No VIF found with MAC fa:16:3e:17:63:48, not building metadata {{(pid=75100) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 18:08:35 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ca38b178-28c3-47d5-87ce-cd337315cc6f tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.798s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:08:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:08:37 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:08:37 user nova-compute[75100]: INFO nova.compute.manager [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Detaching volume 453c79de-623a-4b75-a747-84ec156fc5d9
Nov 13 18:08:37 user nova-compute[75100]: INFO nova.virt.block_device [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Attempting to driver detach volume 453c79de-623a-4b75-a747-84ec156fc5d9 from mountpoint /dev/vdb
Nov 13 18:08:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Attempting to detach device vdb from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the persistent domain config. {{(pid=75100) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 18:08:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:08:37 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:08:37 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 18:08:37 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:08:37 user nova-compute[75100]:   <serial>453c79de-623a-4b75-a747-84ec156fc5d9</serial>
Nov 13 18:08:37 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:08:37 user nova-compute[75100]: </disk>
Nov 13 18:08:37 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:08:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Successfully detached device vdb from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the persistent domain config.
Nov 13 18:08:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the live domain config. {{(pid=75100) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 18:08:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.guest [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 18:08:37 user nova-compute[75100]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 18:08:37 user nova-compute[75100]:   <source dev="/dev/sdb"/>
Nov 13 18:08:37 user nova-compute[75100]:   <target dev="vdb" bus="virtio"/>
Nov 13 18:08:37 user nova-compute[75100]:   <serial>453c79de-623a-4b75-a747-84ec156fc5d9</serial>
Nov 13 18:08:37 user nova-compute[75100]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 18:08:37 user nova-compute[75100]: </disk>
Nov 13 18:08:37 user nova-compute[75100]:  {{(pid=75100) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 18:08:38 user nova-compute[75100]: DEBUG nova.virt.libvirt.driver [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 18:08:38 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:41 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:46 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:08:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:08:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:08:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:08:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:08:51 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:55 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:08:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:08:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:08:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 18:08:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquired lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 18:08:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Forcefully refreshing network info cache for instance {{(pid=75100) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 18:08:55 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lazy-loading 'info_cache' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:08:55 user nova-compute[75100]: DEBUG nova.network.neutron [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating instance_info_cache with network_info: [{"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:08:55 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Releasing lock "refresh_cache-1e93d1e4-1f86-4ef2-9769-adfca6f54c74" {{(pid=75100) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 18:08:55 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updated the network info_cache for instance {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 18:08:56 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:08:57 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:08:58 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 is timed out.
Nov 13 18:08:58 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Successfully detached device vdb from instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 from the live domain config.
Nov 13 18:08:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] calling os-brick to detach iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fda5c43e770>, {'target_iqn': 'iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XCzTJldI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 18:08:58 user nova-compute[75100]: WARNING os_brick.initiator.connectors.base [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a82f25-a9b6-415d-93b8-46142bdeb806]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 18:08:58 user nova-compute[75100]: No targets found.
Nov 13 18:08:58 user nova-compute[75100]: iSNS:
Nov 13 18:08:58 user nova-compute[75100]: No targets found.
Nov 13 18:08:58 user nova-compute[75100]: STATIC:
Nov 13 18:08:58 user nova-compute[75100]: Target: iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9
Nov 13 18:08:58 user nova-compute[75100]:         Portal: 172.16.0.220:3260,-1
Nov 13 18:08:58 user nova-compute[75100]:                 Iface Name: default
Nov 13 18:08:58 user nova-compute[75100]: FIRMWARE:
Nov 13 18:08:58 user nova-compute[75100]: No targets found.
Nov 13 18:08:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 18:08:58 user nova-compute[75100]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 18:08:58 user nova-compute[75100]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75100) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9', 0)] {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d142d6e0-e386-4b9c-82e7-a296f54cc144]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[690372b0-c3cc-4088-b36f-099907dc18ba]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 (non-flash)
Nov 13 18:08:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 (non-flash)
Nov 13 18:08:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fda38a105e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9'): ({'sdb'}, set())}) {{(pid=75100) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Removing single pathed devices sdb {{(pid=75100) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7e47f6-7c34-40b8-adab-48ab54642190]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[254e1cc1-4a5d-46fa-96c7-98776b8ee2eb]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Flushing IO for device /dev/sdb {{(pid=75100) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[d137ca0c-f21e-4bcd-af93-9a22f48e16ea]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75100) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc07aabd-45da-4f29-92da-78a5672c8635]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.linuxscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] SCSI volumes sdb have been removed. {{(pid=75100) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9')] {{(pid=75100) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9a23ac-49f6-4d06-9c02-076a63164796]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.040s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefbe986-8421-4dd7-9ec2-4e5c5dc968bc]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9, portal: 172.16.0.220,3260]
Nov 13 18:08:58 user nova-compute[75100]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9, portal: 172.16.0.220,3260] successful.
Nov 13 18:08:58 user nova-compute[75100]:  stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:453c79de-623a-4b75-a747-84ec156fc5d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd715ee-5123-44b6-b295-e0dbabafe48d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75100) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.base [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] <== disconnect_volume: return (266ms) None {{(pid=75100) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 18:08:58 user nova-compute[75100]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Disconnected iSCSI Volume {{(pid=75100) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 18:08:59 user nova-compute[75100]: DEBUG nova.objects.instance [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'flavor' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:08:59 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-d91de3f4-9638-495f-ac38-78b0a2d7b9d0 tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.557s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:09:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:09:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:09:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:09:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:09:00 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:09:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:09:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:09:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 18:09:00 user nova-compute[75100]: DEBUG oslo_concurrency.processutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75100) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 18:09:01 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:09:01 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:09:01 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=24.984943389892578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:09:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:09:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:09:01 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75100) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 18:09:01 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:09:01 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:09:01 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:09:01 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:09:01 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:09:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:09:01 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:09:02 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:09:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:09:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:09:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:09:06 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:09:10 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:09:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:09:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:09:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:09:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:09:11 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:14 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:09:14 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:09:16 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:09:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:09:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:09:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:09:21 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:26 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:09:31 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:09:36 user nova-compute[75100]: INFO nova.compute.manager [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Terminating instance
Nov 13 18:09:36 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Start destroying the instance on the hypervisor. {{(pid=75100) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-151fc3e6-c80f-4617-a52a-0872ddf505e2 req-4af41d5b-602e-4d13-b70f-13ac3f356eab service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Received event network-vif-unplugged-a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-151fc3e6-c80f-4617-a52a-0872ddf505e2 req-4af41d5b-602e-4d13-b70f-13ac3f356eab service nova] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-151fc3e6-c80f-4617-a52a-0872ddf505e2 req-4af41d5b-602e-4d13-b70f-13ac3f356eab service nova] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-151fc3e6-c80f-4617-a52a-0872ddf505e2 req-4af41d5b-602e-4d13-b70f-13ac3f356eab service nova] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-151fc3e6-c80f-4617-a52a-0872ddf505e2 req-4af41d5b-602e-4d13-b70f-13ac3f356eab service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] No waiting events found dispatching network-vif-unplugged-a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG nova.compute.manager [req-151fc3e6-c80f-4617-a52a-0872ddf505e2 req-4af41d5b-602e-4d13-b70f-13ac3f356eab service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Received event network-vif-unplugged-a0736df0-5f6b-418a-871c-8ac3b0b9719b for instance with task_state deleting. {{(pid=75100) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 18:09:36 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [-] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Instance destroyed successfully.
Nov 13 18:09:37 user nova-compute[75100]: DEBUG nova.objects.instance [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lazy-loading 'resources' on Instance uuid 1e93d1e4-1f86-4ef2-9769-adfca6f54c74 {{(pid=75100) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG nova.virt.libvirt.vif [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T18:03:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-451288130',display_name='tempest-SnapshotDataIntegrityTests-server-451288130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-451288130',id=53,image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOf7K7gLHorVcw5GiOJJrlWwtCFWHF3op6oARF6Zt6atOLh18AMiHA62Y6hVszsIjYvHP7DoyrCH24/T2ORpri9nUQqkz/QDh8yHUfEEWS/9dmpSqLLXrQYkkkXNMY3EuQ==',key_name='tempest-keypair-1051146085',keypairs=<?>,launch_index=0,launched_at=2023-11-13T18:03:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbbe120ff21a4507b2be087d93c288c5',ramdisk_id='',reservation_id='r-bvc39jh0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='40ac832f-026d-4a87-87c5-ec47fa8f4825',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1846863586',owner_user_name='tempest-SnapshotDataIntegrityTests-1846863586-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T18:03:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f392a16f9c1b49f1885a2a5fa2647f98',uuid=1e93d1e4-1f86-4ef2-9769-adfca6f54c74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Converting VIF {"id": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "address": "fa:16:3e:17:63:48", "network": {"id": "51bd3e79-ed64-4b56-92bb-db2760b37599", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1626696558-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbbe120ff21a4507b2be087d93c288c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0736df0-5f", "ovs_interfaceid": "a0736df0-5f6b-418a-871c-8ac3b0b9719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG nova.network.os_vif_util [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:63:48,bridge_name='br-int',has_traffic_filtering=True,id=a0736df0-5f6b-418a-871c-8ac3b0b9719b,network=Network(51bd3e79-ed64-4b56-92bb-db2760b37599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0736df0-5f') {{(pid=75100) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG os_vif [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:63:48,bridge_name='br-int',has_traffic_filtering=True,id=a0736df0-5f6b-418a-871c-8ac3b0b9719b,network=Network(51bd3e79-ed64-4b56-92bb-db2760b37599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0736df0-5f') {{(pid=75100) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0736df0-5f, bridge=br-int, if_exists=True) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ded5fde-2b26-427a-9862-d10358adb77b) {{(pid=75100) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:09:37 user nova-compute[75100]: INFO os_vif [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:63:48,bridge_name='br-int',has_traffic_filtering=True,id=a0736df0-5f6b-418a-871c-8ac3b0b9719b,network=Network(51bd3e79-ed64-4b56-92bb-db2760b37599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0736df0-5f')
Nov 13 18:09:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Deleting instance files /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74_del
Nov 13 18:09:37 user nova-compute[75100]: INFO nova.virt.libvirt.driver [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Deletion of /opt/stack/data/nova/instances/1e93d1e4-1f86-4ef2-9769-adfca6f54c74_del complete
Nov 13 18:09:37 user nova-compute[75100]: INFO nova.compute.manager [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 18:09:37 user nova-compute[75100]: DEBUG oslo.service.loopingcall [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75100) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG nova.compute.manager [-] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Deallocating network for instance {{(pid=75100) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 18:09:37 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] deallocate_for_instance() {{(pid=75100) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 18:09:38 user nova-compute[75100]: DEBUG nova.network.neutron [-] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Updating instance_info_cache with network_info: [] {{(pid=75100) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 18:09:38 user nova-compute[75100]: INFO nova.compute.manager [-] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Took 0.84 seconds to deallocate network for instance.
Nov 13 18:09:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:09:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:09:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-44c6bcb6-a308-432c-a4d4-0be78dbffe4f req-32c25b8c-8bd1-4007-829e-f1ae0fc444cb service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Received event network-vif-deleted-a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:09:38 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:09:38 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:09:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:09:38 user nova-compute[75100]: INFO nova.scheduler.client.report [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Deleted allocations for instance 1e93d1e4-1f86-4ef2-9769-adfca6f54c74
Nov 13 18:09:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ec617568-3233-4d1a-bf69-fd5981a10b4a tempest-SnapshotDataIntegrityTests-1846863586 tempest-SnapshotDataIntegrityTests-1846863586-project-member] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.989s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:09:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-e5ecb6c1-1ec8-4b96-9d99-61ded6e5a39e req-bcd93ec3-97bc-4b4f-a234-98eabe75793c service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Received event network-vif-plugged-a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 18:09:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e5ecb6c1-1ec8-4b96-9d99-61ded6e5a39e req-bcd93ec3-97bc-4b4f-a234-98eabe75793c service nova] Acquiring lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:09:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e5ecb6c1-1ec8-4b96-9d99-61ded6e5a39e req-bcd93ec3-97bc-4b4f-a234-98eabe75793c service nova] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:09:38 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [req-e5ecb6c1-1ec8-4b96-9d99-61ded6e5a39e req-bcd93ec3-97bc-4b4f-a234-98eabe75793c service nova] Lock "1e93d1e4-1f86-4ef2-9769-adfca6f54c74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:09:38 user nova-compute[75100]: DEBUG nova.compute.manager [req-e5ecb6c1-1ec8-4b96-9d99-61ded6e5a39e req-bcd93ec3-97bc-4b4f-a234-98eabe75793c service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] No waiting events found dispatching network-vif-plugged-a0736df0-5f6b-418a-871c-8ac3b0b9719b {{(pid=75100) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 18:09:38 user nova-compute[75100]: WARNING nova.compute.manager [req-e5ecb6c1-1ec8-4b96-9d99-61ded6e5a39e req-bcd93ec3-97bc-4b4f-a234-98eabe75793c service nova] [instance: 1e93d1e4-1f86-4ef2-9769-adfca6f54c74] Received unexpected event network-vif-plugged-a0736df0-5f6b-418a-871c-8ac3b0b9719b for instance with vm_state deleted and task_state None.
Nov 13 18:09:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:09:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:09:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:09:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:09:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:09:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:09:57 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:09:57 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:09:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Starting heal instance info cache {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 18:09:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Rebuilding the list of instances to heal {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 18:09:57 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Didn't find any instances for network info cache update. {{(pid=75100) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 18:09:58 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:10:00 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:10:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:10:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:10:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:10:00 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Auditing locally available compute resources for user (node: user) {{(pid=75100) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 18:10:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:10:00 user nova-compute[75100]: WARNING nova.virt.libvirt.driver [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 18:10:00 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Hypervisor/Node resource view: name=user free_ram=9145MB free_disk=25.012039184570312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75100) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 18:10:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 18:10:00 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 18:10:00 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 18:10:00 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75100) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 18:10:00 user nova-compute[75100]: DEBUG nova.compute.provider_tree [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed in ProviderTree for provider: d0cd9ee7-47c1-40a1-b685-446f6384b590 {{(pid=75100) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 18:10:00 user nova-compute[75100]: DEBUG nova.scheduler.client.report [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Inventory has not changed for provider d0cd9ee7-47c1-40a1-b685-446f6384b590 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75100) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 18:10:01 user nova-compute[75100]: DEBUG nova.compute.resource_tracker [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Compute_service record updated for user:user {{(pid=75100) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 18:10:01 user nova-compute[75100]: DEBUG oslo_concurrency.lockutils [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75100) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 18:10:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:10:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:10:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:10:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:10:02 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:10:03 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:10:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:10:05 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:10:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:10:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75100) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 18:10:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:10:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75100) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 18:10:07 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 18:10:11 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:10:12 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:15 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:10:15 user nova-compute[75100]: DEBUG nova.compute.manager [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75100) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 18:10:17 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:22 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:26 user nova-compute[75100]: DEBUG oslo_service.periodic_task [None req-ebbb6fa1-30df-447a-95c1-658c129fdf30 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75100) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 18:10:27 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:30 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:32 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:34 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:37 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:42 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:47 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 18:10:52 user nova-compute[75100]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75100) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}